{"id":3593118,"url":"https://alion.io/job/ncs-australia-data-platform-engineer","title":"Data Platform Engineer","company":{"id":6612,"name":"NCS Australia","domain":"ncs.com.au","url":"https://alion.io/company/ncs","size_band":null,"is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":31,"computed_at":"2026-11-03T05:54:40Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"contractor","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Brisbane, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":74000,"max_usd":151000,"period":"year","method":"role_country_seniority_unknown","sample_n":13},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"ElasticSearch","optional":false},{"name":"GitLab CI","optional":false},{"name":"Platform Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"RabbitMQ","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":".NET","optional":true},{"name":"Agile","optional":true},{"name":"C#","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-01T22:02:36Z","employer_posted_date":"2026-11-01","last_verified_at":"2026-11-03T10:06:10Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"Make extraordinary happen\nAt NCS Australia, we’re the challenger alternative in technology services and consulting. With more than 47 years of Australian heritage, we partner with governments and leading organisations to solve complex challenges, embrace new opportunities and deliver outcomes that make a real difference.\nOur people bring together expertise across technology, consulting, delivery, operations, sales and corporate functions. We work collaboratively, challenge the status quo and give our people the opportunity to make an impact - for our clients, our communities and each other.\n We are seeking a Data Platform Engineer with strong quality engineering and automation expertise to support the development, validation, and reliability of large-scale data platforms. This role will focus on Databricks Lakehouse, PySpark, SQL, distributed data pipelines, event-driven architectures, and cloud-based data ecosystems, while also supporting automated testing, data validation, CI/CD quality gates, and platform resilience.\nThe successful candidate will play a key role in ensuring end-to-end data integrity across complex systems, validating data flows between applications and data platforms, and supporting performance, scalability, and reliability initiatives. Working closely with cross-functional teams, the individual will leverage strong Databricks, Python, and SQL expertise to investigate data quality issues, validate platform behaviour, and contribute to the continuous improvement of automation and engineering practices.\nThis is a hands-on technical role suited to a data engineering professional who can operate independently, collaborate across multiple teams, and apply quality engineering principles within a modern data platform environment. While testing and automation experience are important, the primary focus is deep expertise in Databricks, Python, SQL, and data platform engineering.\nResponsibilities\nDesign, develop, and maintain automated test frameworks and test suites.\nBuild and enhance quality gates within GitLab CI/CD pipelines.\nPerform end-to-end testing of complex distributed data flows.\nValidate data integrity across RabbitMQ, Databricks Lakehouse, Lakebase, and Elasticsearch platforms.\nConduct functional, integration, regression, and data validation testing.\nCollaborate with developers, platform engineers, and fellow SDETs to ensure seamless system integration.\nCoordinate cross-team testing activities across multiple application teams.\nDesign and execute load, performance, and scalability testing strategies.\nPerform chaos testing and resilience validation of distributed systems.\nInvestigate and troubleshoot data discrepancies across multiple storage systems.\nContribute to continuous improvement of test automation practices and quality engineering standards.\n Proven experience as a Senior Data Engineer, Data Platform Engineer, SDET, Data Quality Engineer, or similar technical role.\nStrong hands-on experience with Python, PySpark, and SQL in enterprise-scale environments.\nDemonstrated experience working with Databricks Lakehouse and large-scale distributed data processing platforms.\nExperience validating and testing complex data pipelines, data integrations, and distributed systems.\nStrong understanding of data quality, data validation, and automated testing methodologies.\nExperience with GitLab CI/CD and implementing automated quality gates within deployment pipelines.\nExperience working with Elasticsearch, event-driven architectures, and message brokers such as RabbitMQ.\nKnowledge of Infrastructure as Code (IaC) tools, preferably Terraform.\nStrong analytical, problem-solving, and troubleshooting skills.\nExcellent communication and stakeholder management skills with the ability to collaborate across multiple teams.\nDesirable Qualifications & Experience\n\nExperience with performance, load, scalability, resilience, and chaos testing.\nExperience working within cloud-native and modern data platform environments.\nExposure to DevOps and Site Reliability Engineering (SRE) practices.\nKnowledge of C# and .NET technologies.\nExperience working in Agile delivery environments.\nRelevant certifications in Databricks, Cloud Technologies, or Data Engineering would be advantageous.\n Why NCS?\nThis is a place for people who like to get stuck in, bring ideas to life and make things happen. You'll work alongside experienced people who care about what they do, contribute to meaningful work and have the support to keep learning and grow your career. Whether you want to deepen your expertise, explore something new or take your career in a different direction, there's room to make it your own. We value Adventure, Excellence, Integrity, Ownership and Unity - bringing curiosity, collaboration and accountability to the way we work with our clients and each other.\nReady to make extraordinary happen?\nWe'd love to hear from you.\nWe celebrate diversity and inclusion\nWe value different perspectives, experiences and strengths our people bring. We're committed to an inclusive workplace where everyone has the opportunity to contribute, grow and succeed, and to providing equal employment opportunities and reasonable adjustments throughout the recruitment process.\nImportant information\nApplicants will need valid Australian work rights and may be required to undergo relevant background, probity and police checks.\nAgencies: NCS accepts candidate submissions only from agencies on our preferred supplier panel through the NCS Agency Portal.","description_format":"text","description_chars":5513,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Australia","iso":"AU","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Managed Security","IT Consulting & Digital Transformation","Managed IT Services (MSP)","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-11-01T22:35:50Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":31,"reasons":["conf:0","velocity","win:early"],"computed_at":"2026-11-03T05:54:40Z"},"pay":null,"html_url":"https://alion.io/job/ncs-australia-data-platform-engineer","json_url":"https://alion.io/job/ncs-australia-data-platform-engineer.json","meta":{"generated_at":"2026-11-03T11:08:39Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":15301,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-04T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6612},"rest":"https://alion.io/mcp/rest/get_company?id=6612"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fncs-australia-data-platform-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fncs-australia-data-platform-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fncs-australia-data-platform-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ncs-australia-data-platform-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fncs-australia-data-platform-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3593118}},{"tool":"search_jobs","arguments":{"company":"ncs.com.au","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3593118},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}