{"id":3271253,"url":"https://alion.io/job/xtremax-senior-data-engineer-aws-databricks-public-sector","title":"Senior Data Engineer - AWS & Databricks (Public Sector)","company":{"id":3414,"name":"Xtremax","domain":"xtremax.com","url":"https://alion.io/company/xtremax-pte-ltd","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":{"grade":"A","score":89,"open_postings":48,"ghost_share":0,"stale_share":0.25,"repost_share":0,"time_to_fill_p50_days":60,"computed_at":"2026-10-28T05:59:10Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Singapore"],"countries":["SG"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":56000,"max_usd":114000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":50},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon CloudWatch","optional":false},{"name":"Amazon EventBridge","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Anomaly Detection","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Glue","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"Feature Store","optional":false},{"name":"Git","optional":false},{"name":"IAM","optional":false},{"name":"Least Privilege","optional":false},{"name":"Machine Learning","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-10-26T11:48:05Z","employer_posted_date":"2026-10-26","last_verified_at":"2026-10-29T02:41:37Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"At Xtremax, we're looking for a Senior Data Engineer to design, build and operate dependable data pipelines and reusable data products on AWS and Databricks. You'll help establish the data foundations that support analytics, reporting and machine learning, ensuring that information remains reliable, well-governed and ready for production use.\nYou'll lead engineering work across data ingestion, transformation, modelling, quality validation, orchestration, lineage and performance optimisation. Using Python, PySpark, SQL, Apache Spark and Delta Lake, you'll build production-grade pipelines that handle complex data sources, incremental updates and operational recovery while maintaining clear data contracts and ownership.\nThis role combines hands-on engineering with technical leadership. You'll work with data owners, analysts, data scientists, architects and platform teams to translate business needs into maintainable data solutions, improve engineering standards and develop reusable patterns that make data services easier to operate and scale.\nResponsibilities\nLead the design and implementation of reliable batch and streaming pipelines across AWS and Databricks.\nBuild lakehouse architectures using Delta Lake and layered Bronze, Silver and Gold data patterns.\nDevelop reusable data models, curated datasets and data products with clear definitions, ownership and service expectations.\nImplement source integration and incremental processing for databases, files, APIs and event streams, including change data capture, replay and recovery.\nEstablish data contracts, schema enforcement, automated quality checks, reconciliation and anomaly detection.\nBuild and maintain workflows using Databricks Workflows, Lakeflow and relevant AWS orchestration services.\nImplement metadata, lineage, classification and access controls using Unity Catalog, AWS Glue Data Catalog, Lake Formation or approved platform capabilities.\nDevelop monitoring, dashboards, alerts and operational runbooks for pipeline health, data freshness, quality, latency and downstream impact.\nOptimise Spark and SQL workloads, partitioning, clustering, caching and cluster configuration to improve performance and cost efficiency.\nApply cloud security practices covering least-privilege access, encryption, secrets management, environment separation and audit logging.\nReview technical designs and code, establish engineering standards, mentor engineers and promote reusable components.\nCollaborate with data owners, analysts, data scientists and governance stakeholders to define data requirements and acceptance criteria.\nMaintain technical documentation and transfer operational knowledge to support sustainable internal ownership.\nRequirements\nDegree or diploma in Computer Science, Software Engineering, Data Engineering, Information Systems or a related technical discipline.\nTypically 6-10 years of relevant data or software engineering experience, including production data pipeline design and operation.\nAt least two years of experience working with cloud-based data platforms.\nStrong Python, PySpark and SQL skills, including distributed processing, complex transformations, query optimisation, debugging and automated testing.\nHands-on experience with Databricks, Apache Spark and Delta Lake for production-scale batch or streaming data engineering.\nPractical AWS data engineering experience across relevant services such as S3, Glue, Lake Formation, IAM, KMS, Lambda, Step Functions, EventBridge, CloudWatch or Redshift.\nExperience designing lakehouse or data-lake architectures, layered data patterns, dimensional or domain data models and reusable datasets.\nExperience with incremental ingestion, change data capture, idempotency, late-arriving data, backfills, replay and recovery.\nExperience implementing data quality validation, schema enforcement, reconciliation, metadata and lineage in production pipelines.\nFamiliarity with workflow orchestration, Git-based development, CI/CD, infrastructure as code such as Terraform and environment promotion.\nExperience implementing monitoring, operational dashboards, alerting, runbooks, incident diagnosis and service recovery.\nWorking knowledge of cloud security, data classification, access controls, encryption and audit logging.\nAbility to review designs and code, establish engineering standards and guide less-experienced engineers.\nPreferred\nExperience with Unity Catalog, Lakeflow, Delta Live Tables, Auto Loader, Structured Streaming or Delta Sharing.\nFamiliarity with Apache Airflow, dbt, Kafka, Amazon MSK/Kinesis or AWS DMS.\nExperience with data products, data contracts, semantic layers or data mesh-aligned operating models.\nExperience supporting feature engineering, ML training datasets, feature stores or MLOps pipelines.\nFamiliarity with Singapore public-sector security, data classification and governed data-sharing requirements.\nDatabricks or AWS data engineering certifications.\nBenefits\nBy submitting your resume/CV, you consent and agree to allow the information provided to be used and processed by or on behalf of Xtremax Pte Ltd for purposes related to your registration of interest in current or future employment with us and for the processing of your application for employment.\nYou also represent to us that you have obtained the consent of your referees when you disclose to us their personal data for the purpose of conducting reference checks.\nThe personal data held by us relating to your application will be kept strictly confidential and in accordance with the PDPA. You may also refer to our Privacy Policy for more details here:\nWe regret to inform you that should you not consent to providing the necessary data required for us to process your application, your application will be considered void.","description_format":"text","description_chars":5775,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Government","IT Consulting & Digital Transformation","Managed IT Services (MSP)","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-26T11:48:05Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":60,"reasons":["conf:0","velocity","win:early"],"computed_at":"2026-10-28T05:59:10Z"},"pay":null,"html_url":"https://alion.io/job/xtremax-senior-data-engineer-aws-databricks-public-sector","json_url":"https://alion.io/job/xtremax-senior-data-engineer-aws-databricks-public-sector.json","meta":{"generated_at":"2026-10-29T03:05:22Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4652,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-30T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3414},"rest":"https://alion.io/mcp/rest/get_company?id=3414"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fxtremax-senior-data-engineer-aws-databricks-public-sector"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fxtremax-senior-data-engineer-aws-databricks-public-sector"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fxtremax-senior-data-engineer-aws-databricks-public-sector"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/xtremax-senior-data-engineer-aws-databricks-public-sector\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fxtremax-senior-data-engineer-aws-databricks-public-sector"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3271253}},{"tool":"search_jobs","arguments":{"company":"xtremax.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3271253},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}