Python Fullstack Engineer

About the role
Join the team behind the shared Recommender service that powers personalised suggestions for jobs, courses, careers and learning content across public-sector products, including MyCareersFuture, MySkillsFuture and CSC Learn. The platform is live and runs both traditional ML models and LLM-based recommendations. You'll keep it reliable, secure and compliant, and help agency teams build on top of it.

What you'll do

• Platform reliability: Maintain the recommendation APIs and services. Handle bug fixes, refactoring and small enhancements, review PRs, monitor production health, lead incident response and root-cause analysis, manage upgrades and patches, and keep GCC hosting costs under control.
• Data pipelines and batch jobs: Maintain the pipelines that feed the recommenders (ingestion, feature and embedding generation, scheduled jobs). Oversee batch jobs such as data refreshes, model retraining and bulk recommendation generation. Set up monitoring and data quality checks, and troubleshoot issues in SQL and PySpark on Databricks.
• Security and compliance: Own the platform's security posture under government ICT policies (e.g. IM8). Coordinate VAPT and code or dependency scans and remediate findings on time. Prepare documentation for security assessments, audits and AI governance clearances. Ensure sensitive personal data is handled correctly.
• Documentation and agency support: Keep runbooks, architecture docs and integration guides current, and act as the technical point of contact for agency engineering teams.

What we're looking for

• 5+ years of professional software engineering experience, with strong backend skills in Python
• Experience running production APIs and services on cloud (AWS preferred) with Docker and Kubernetes, including monitoring, alerting and incident management
• Hands-on experience with data pipelines and scheduled batch jobs, with SQL and Spark/PySpark required
• Solid grounding in secure application practices, and experience remediating security findings (e.g. from VAPT or scans)
• Able to pick up an existing codebase quickly with little guidance, and actively uses agentic AI coding tools

Nice to have

• Databricks or Airflow
• ML or LLM systems in production
• Recommender systems experience

Skills

Data Quality Checks, Dependency Management, PySpark, Security Compliance, Apache Spark, Kubernetes, GCC, Job Scheduling, Develop Recommendations, Professional Experience, Model Training, ICT Governance, Bug Fixing, Codebase, Python, Recommender Systems, Cloud Services, Docker, Scanning Documents, Security Research