{"id":4380812,"url":"https://alion.io/job/commonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python","title":"Principal Data Engineer (Snowflake, AWS, Python)","company":{"id":186,"name":"Commonwealth Bank of Australia","domain":"commbank.com.au","url":"https://alion.io/company/commonwealth-bank-of-australia","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":84,"open_postings":33,"ghost_share":0.242,"stale_share":0.03,"repost_share":0.394,"time_to_fill_p50_days":14,"computed_at":"2026-11-16T05:46:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"lead","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Eveleigh, Australia","Melbourne, Australia"],"countries":["AU"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Amazon ECS","optional":false},{"name":"Amazon EKS","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS CDK","optional":false},{"name":"AWS Lambda","optional":false},{"name":"CI/CD","optional":false},{"name":"CloudFormation","optional":false},{"name":"Copilot Studio","optional":false},{"name":"Databricks","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"DynamoDB","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Flink","optional":false},{"name":"GitHub Actions","optional":false},{"name":"Hadoop","optional":false},{"name":"IAM","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Teradata","optional":false},{"name":"Kubernetes","optional":true}],"status":"live","first_seen_at":"2026-11-16T16:14:07Z","employer_posted_date":"2026-11-16","last_verified_at":"2026-11-16T16:14:07Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"We’re building smarter, real-time customer experiences with AWS, Snowflake and Kafka.\nYou have deep data engineering expertise and thrive on solving complex problems at scale.\nTogether we will modernise data platforms and use AI to transform customer experiences.\nDo work that matters:\nJoin our Customer Service Network team within Assisted Technology and help reimagine how our branch colleagues support millions of customers. As a Principal Data Engineer, you’ll provide hands-on technical leadership across AWS, Snowflake and modern data engineering, building scalable platforms that turn complex data into simpler, smarter customer experiences.You’ll shape architecture, modernise legacy data environments and engineer solutions across Spark, Kafka/MSK, batch and real-time streaming. From setting engineering standards to using AI-assisted engineering to accelerate delivery, you’ll influence how we build while mentoring engineers and lifting capability across the team.\nSee yourself in our team:\nOur Customer Service Network team, within Assisted Technology, is reimagining how data and technology help our branch colleagues serve customers. We’re building the data foundations behind intelligent concierge experiences, agentic appointment booking, customer-intent capture, skills matching and smarter branch operations, connecting customer journeys, colleague experiences and operational data in real time.\nWe’re creating a modern, cloud-first data ecosystem using AWS, Snowflake and Kafka, with real-time messaging, event-driven architectures and scalable data pipelines at its core. The team is also exploring AI-powered engineering and AI-ready data capabilities to turn trusted, real-time data into smarter experiences and decisions. With significant greenfield engineering ahead, we’re solving complex data challenges together and building capabilities designed to help colleagues serve customers faster, smarter and more seamlessly.\nWe’re interested in hearing from people who:\nBring Principal-level technical leadership across data engineering, architecture and full-cycle delivery\nHave deep hands-on experience building large-scale, enterprise data platforms on AWS\nAre highly proficient in Python, building production-grade data pipelines, services and engineering solutions\nHave strong experience with Kafka and real-time messaging, including streaming and event-driven architectures\nCan architect batch, streaming and near-real-time data solutions across complex environments\nOwn solutions end to end, from problem definition and architecture through engineering, deployment, observability and optimisation\nThrive on solving big, complex engineering problems, simplifying disconnected systems and making pragmatic architectural decisions\nHave experience modernising data ecosystems, including migration from legacy warehouse technologies toward Snowflake\nStay hands-on as a Principal Engineer, setting engineering standards, mentoring others and lifting technical capability across teams\nTech skills\nWe don't expect you to know everything, but experience in several of the following will set you up for success:\nCloud: AWS, S3, Lambda, Kinesis, Redshift, Glue, EMR, Athena, IAM, SQS/SNS, ECS/EKS, DynamoDB\nData Platform: Snowflake, Databricks\nData Modernisation: Enterprise-scale data platform and warehouse modernisation/migration, Teradata to Snowflake\nCore Engineering: Python, PySpark, SQL, Scala\nDistributed Processing: Apache Spark, distributed processing, batch processing, streaming\nReal-Time Streaming: Kafka, Amazon MSK, Flink\nArchitecture: Enterprise data architecture, scalable solution design, systems integration\nData Modelling: Dimensional modelling, semantic modelling, entity resolution, matching, deduplication, reconciliation, data quality\nData Engineering: ETL, complex enterprise data pipelines\nData Warehousing: Snowflake, Teradata, Hadoop/Cloudera, Hive, Oracle\nDevOps: CI/CD, GitHub Actions, Infrastructure as Code, CloudFormation, AWS CDK\nAI-Assisted Engineering: AI-assisted development, ETL automation, engineering productivity, quality and delivery acceleration\nAI / GenAI: GenAI concepts and practical engineering applications\n Microsoft Ecosystem: Microsoft Fabric, Copilot Studio\nIf you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.\nWe're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.\nAdvertising End Date: 15/12/2026","description_format":"text","description_chars":4713,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Commercial & Retail Banks","Mortgage Lending & Brokers","Online Brokerage & Trading Platforms"],"lifecycle":[{"event":"open","at":"2026-11-16T16:14:07Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":14,"reasons":["conf:2","win:early","comp:brand"],"computed_at":"2026-11-16T19:05:33Z"},"pay":null,"html_url":"https://alion.io/job/commonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python","json_url":"https://alion.io/job/commonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python.json","meta":{"generated_at":"2026-11-16T19:05:33Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":3277,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-17T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":186},"rest":"https://alion.io/mcp/rest/get_company?id=186"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcommonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcommonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcommonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/commonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcommonwealth-bank-of-australia-principal-data-engineer-snowflake-aws-python"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4380812}},{"tool":"search_jobs","arguments":{"company":"commbank.com.au","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4380812},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}