{"id":2378373,"url":"https://alion.io/job/caci-data-engineer","title":"Data Engineer","company":{"id":1760862,"name":"CACI","domain":"caci.co.uk","url":"https://alion.io/company/caci-co-uk","size_band":"1001-5000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Dayforce","truth_index":{"grade":"B","score":75,"open_postings":9,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-13T05:45:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Hyderabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Amazon Aurora","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Amazon SageMaker","optional":false},{"name":"AWS","optional":false},{"name":"AWS Fargate","optional":false},{"name":"AWS Lambda","optional":false},{"name":"AWS Step Functions","optional":false},{"name":"CI/CD","optional":false},{"name":"CloudFormation","optional":false},{"name":"Git","optional":false},{"name":"GitLab","optional":false},{"name":"Jira","optional":false},{"name":"Machine Learning","optional":false},{"name":"Oracle","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false}],"status":"live","first_seen_at":"2026-07-23T19:30:00Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-13T20:37:55Z","board_verified":true,"closed_at":null,"days_open":82,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":82},"description":"About CACI Data Engineering \nCACI has implemented a Data Platform that supports and enables a Data Mesh organisation. It uses AWS technology to provide a unified experience across AWS services to deliver an open federated Lakehouse, and a unified User Experience. \nThe Data Platform focusses on enabling decentralised management, processing, analysis and delivery of data, while enforcing corporate wide federated governance on data, and project environments across business domains. \nThe goal is to empower multiple teams to create and manage high integrity data and data products that are analytics and AI ready and consumed internally and externally. \nData Engineers will be part of a community of data engineers and are often embedded in different business units to develop data pipelines and products, maintaining these for use in consulting engagements and service delivery to clients.\nData Engineers will work with the platform, corporate standards and processes. In a business that values continuous improvement, data engineers are expected to contribute to improving the wider data engineering capability in the business. \n\nWhat does a Data Engineer do? \nA Data Engineer partners closely with business units to maintain existing cloud data architectures, as well as assess, design and execute the migration of their existing cloud and on premise/desktop data products and workflows onto a modern cloud data platform \nThis involves understanding current data architectures, dependencies and transformation logic, and translating that into cloud native solutions in harmony with the Company data platform, governance and strategy. \nThe Senior Data Engineer will need skills in developing data pipelines that operate across a medallion architecture, with an obsession on data quality and integrity of the products and processes and always considering the cost benefit of different approaches. This will need attention to technical rigour and pragmatic delivery. \nYou will leverage skills in AWS Services such as Glue, EMR, S3, MWAA (Apache Airflow), Step Functions, Redshift, Sagemaker Unified Studio, as well as an understanding of traditional RDBMS in Postgres, Oracle and SQL Server. SQL, Python and PySpark will be essential in this role. Experience with IaC such as cloud formation will be an important skill to have, or to develop. \nYou will be able to design architectures and create re-useable solutions to reflect the business needs. It is important that we create “Patterns” that we can reuse for multiple products and services, so that we are note designing new solutions for every need. \nSome products will have linear data ingest, transformation and publishing requirements, others will require extensive analytical work in the pipelines, including machine learning, deep learning and the potential to integrate more unstructured data as new products are built and matured. \n\nResponsibilities will include: \nCollaborating across CACI departments to develop and maintain data products and the data platform \nDesigning and implementing data processing environments and integrations using AWS PaaS such as Glue, S3, Lambda, Fargate, EMR, Sagemaker, Redshift, Aurora and Snowflake \nData architecture and data modelling across full data lifecycles, as well as more detailed modelling requirements of databases and data products. \nBuilding data processing and analytics pipelines as code, using python, SQL, PySpark, Spark, CloudFormation, Lambda, Step Functions, Apache Airflow \nDesigning and applying security and access control architectures to secure sensitive data \nEnabling business units by working with them to deliver complete and manageable solutions; while providing support and expert advice. \n\nYou will have: \nStrong experience and knowledge of data architectures implemented in AWS using native AWS services such as S3, DataZone, Glue, EMR, Sagemaker, Aurora and Redshift using Python, PySpark, and SQL \nExperience developing and administrating databases, data platforms and solutions \nGood coding discipline in terms of style, structure, versioning, documentation and unit tests \nA well developed understanding of a data mesh organisation, as well as Master and Reference Data Management \nExperience migrating legacy to modern, as well as modern to modern. \nKnowledge and experience of relational databases such as Postgres, Redshift \nExperience using Git for code versioning, and lifecycle management \nExperience operating to Agile principles and ceremonies \nHands-on experience with CI/CD tools such as GitLab \nStrong problem-solving skills and ability to work independently or in a team environment. \nExcellent communication and collaboration skills. \nA keen eye for detail, and a passion for accuracy and correctness in numbers \n\nWhilst not essential, the following skills would also be useful: \nExperience using Jira, or other agile project management and issue tracking software \nExperience with Spatial Data Processing, technology and approaches. \nExperience with Machine Learning and AI workflows\nExperience with IaC such as cloudformation or terraform","description_format":"text","description_chars":5088,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Design & Creative","Professional Services","Sales & Marketing"],"lifecycle":[{"event":"open","at":"2026-10-12T18:59:13Z"}],"visa":[],"liveness":{"score":8,"band":"cold","label":"Long shot","p_open":1,"p_active":0.275,"p_room":0.28,"age_days":81,"expected_fill_days":20,"reasons":["conf:0","win:tail","crowd:"],"computed_at":"2026-10-13T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/caci-data-engineer","json_url":"https://alion.io/job/caci-data-engineer.json","meta":{"generated_at":"2026-10-14T00:21:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":497,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1760862},"rest":"https://alion.io/mcp/rest/get_company?id=1760862"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcaci-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcaci-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcaci-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/caci-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcaci-data-engineer"}]}