1,581,627open jobs
95,235companies
244,021added this week
Browse all
Salary
$75k – $91k per year
Location
In office (London)
Seniority
Senior
Employment
Full-Time

First seen by Alion on Oct 9, 2026.

Overview
Company
Impact
Profile match
The Alan Turing Institute is the national institute for data science and artificial intelligence in the United Kingdom. Its programmes span foundational research, defence, health and public policy. The institute works with universities and government partners.

HOURS: 36

ROLE PURPOSE
We are looking for a Senior Data Engineer to design and build the data pipelines and infrastructure that transform complex, heterogeneous data into reliable, well-structured resources. Initially, you will focus on the data layer underpinning analyst-facing tools, including curated datasets, data models, serving layers and query interfaces. As the team's machine learning capabilities grow, this foundation will also support feature pipelines, dataset versioning and evaluation data.

You will establish and maintain the team's data platform across cloud and on-premise environments, covering storage, compute, orchestration and access control. Working within Defence and partner environments, you will design solutions that meet technical and security constraints while enabling effective data use.

This is a senior individual contributor role suited to an experienced data engineer who has built and operated data systems at scale, can set technical direction, and is comfortable working within operationally constrained environments.

HOW YOU WILL MAKE AN IMPACT

  • Design, build and operate robust data pipelines that ingest, validate, clean and structure large volumes of varied data, ensuring quality, lineage and reproducibility from the outset.
  • Develop the data products that support the team's tools, including data models, curated datasets, serving layers and query interfaces used by analysts and engineers.
  • Establish and maintain the team's data platform across cloud and on-premise environments, covering storage, compute, orchestration, access control and infrastructure-as-code.
  • Work closely with applied engineers and partner teams to understand how data will be consumed and design solutions that operate effectively within technical and security constraints.
  • Set and maintain the team's data engineering standards, including testing, schema and contract management, documentation and secure data handling, supported by effective code review.
  • Help shape the team's data architecture and ways of working, mentoring colleagues and advising on the future development of data and platform engineering capabilities.

ABOUT YOU

You will bring:

  • Significant experience designing, building and operating production data pipelines across large, complex and poorly structured datasets, including batch and streaming data.
  • Strong Python engineering skills, including testing, packaging, code review and CI/CD practices.
  • Experience deploying and operating data infrastructure, including storage, compute, orchestration and access control, using infrastructure-as-code in cloud and/or on-premise environments.
  • Expertise in designing data models and developing trusted data products, such as curated datasets, serving layers and query interfaces.
  • Experience handling data under security, access-control and audit constraints, and designing systems that respect them by default.
  • The ability to collaborate effectively with engineers, data scientists, analysts and partner organisations, balancing technical ambition with practical delivery constraints.

Terms and Conditions

This position is offered on a fixed-term basis with a salary of £57,000-£69,000 per annum, plus an excellent benefits package, including flexible working and family-friendly policies.

Application Procedure

Please visit our jobs portal for full details of the role and application process.

Eligibility for Developed Vetting (DV) clearance is an essential requirement for this role. Further information on eligibility and the clearance process can be found on the UK Government security vetting  website.

EQUALITY, DIVERSITY AND INCLUSION
We value diversity of background, experience, and perspective, and are proud to be an inclusive employer. We warmly encourage applications from all backgrounds, particularly from groups currently under-represented in our sector.  If you feel passionate about this role but don’t meet every single requirement, please apply – we recognise that great candidates may bring strengths beyond the criteria listed. 

£57,000 to £69,000 per annum, plus an excellent benefits

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
1,581,627 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Data Science
Similar stack
Same company
London
≈ $179k – $344k per year (Estimated) • In office • Full-Time • Bachelor's Degree • San Francisco
Python
Rust
AI/ML
Cursor
Claude Code
AI Agents
Time Series Forecasting
Agentic Workflows
Tool Use
DevOps
GCP
Azure
AWS
Robotics
Digital Twin
Apply
In office • Full-Time
Python
SQL
Python
pySpark
Databases
Delta Lake
MS SQL
Microsoft Fabric
AI/ML
Spark
DevOps
Rest API
Azure DevOps
GitHub Actions
Azure
CI/CD
Analytics
ETL/ELT
Azure Data Factory
Apply
Data Scientist 3 hours ago
$60k per year • Hybrid • 1+ year exp • Bachelor's Degree • Arden Hills
Python
SQL
Databases
Snowflake
AI/ML
Model Context Protocol
Embeddings
LLM
Semantic Search
Semantic Search
Machine Learning
DevOps
Prometheus
Cortex
Apply
≈ $35k – $69k per year (Estimated) • Hybrid • Full-Time • 7+ years exp • Bachelor's Degree • Bengaluru
Python
Java
SQL
Databases
MySQL
PostgreSQL
Firestore
Apache Kafka
Google BigQuery
Google Bigtable
BigQuery
AI/ML
Spark
Airflow
dbt
DevOps
Terraform
GCP
CI/CD
Git
Docker
Kubernetes
Google GKE
Cybersecurity
GDPR
HIPAA
Analytics
Tableau
Power BI
ETL/ELT
Looker
Dimensional Modeling
Apply
≈ $82k – $198k per year (Estimated) • In office • Full-Time • Cologne
Python
Databases
Microsoft Fabric
DevOps
CI/CD
Analytics
Power BI
Apply
≈ $52k – $137k per year (Estimated) • In office • Full-Time • Bachelor's Degree • Pune
Python
Java
TypeScript
Python
FastAPI
Java
Spring Boot
Databases
PostgreSQL
pgvector
Google BigQuery
BigQuery
AI/ML
LangGraph
LangChain
MLFlow
SHAP
Vertex AI
Embeddings
Scikit-learn
Prompt Engineering
AI Agents
LangSmith
Semantic Kernel
PyTorch
LLM
RAG
Reranking
Hybrid Search
OpenAI
Hugging Face
LLMOps
Human-in-the-Loop
Structured Outputs
Multi-Agent Systems
Machine Learning
DevOps
Terraform
Azure DevOps
OpenTelemetry
Azure
CI/CD
Git
Docker
Kubernetes
Platform Engineering
GitHub
Apply
Staff-Data Engineer 10 hours ago
≈ $27k – $54k per year (Estimated) • Hybrid • Full-Time • 8+ years exp • Bachelor's Degree • India
Python
Java
Python
Flask
FastAPI
pySpark
Java
Flyway
Databases
PostgreSQL
Databricks
AI/ML
Spark
LLM
Feature Store
DevOps
Terraform
GCP
Azure DevOps
GitHub Actions
Azure
CI/CD
AWS
AWS Fargate
FinOps
Amazon S3
IAM
Amazon ECS
Analytics
Power BI
Design
Canva
Apply
DevOps-инженер 10 hours ago
≈ $16k – $38k per year (Estimated) • In office • Moscow
Python
Groovy
Databases
PostgreSQL
Apache Kafka
DevOps
Rest API
OpenShift
CI/CD
Jenkins
Git
Docker
Kubernetes
Gitflow
Trunk-Based Development
Bitbucket
kubectl
SLI/SLO/SLA
Linux
Cybersecurity
HashiCorp Vault
PKI
Apply
Technical Specialist 10 hours ago
≈ $12k – $28k per year (Estimated) • Hybrid • Full-Time • 8+ years exp • Bengaluru
JavaScript
TypeScript
Node JS
Node JS
Express
Frontend
Redux
Webpack
Yarn
RxJS
Angular
React.js
Vite
npm
Sass
NgRx
Mobile
State Management
DevOps
Rest API
GCP
Azure
CI/CD
Git
AWS
Docker
Kubernetes
Management
Agile
Scrum
QA
Cypress
Jest
Apply
Supply Planner Intern 10 hours ago
≈ $28k – $55k per year (Estimated) • In office • Internship • Geneva
AI/ML
Machine Learning
Analytics
Power BI
Apply
$75k – $91k per year • Hybrid • Full-Time • London
Apply
$61k – $75k per year • Hybrid • Full-Time • London
DevOps
HPC
Apply
$60k – $77k per year • In office • Full-Time • London
AI/ML
Machine Learning
Apply
Program Manager BTI 6 hours ago
$79k – $109k per year • Hybrid • Full-Time • 3+ years exp • Irving • Barcelona • London • Stamford
Apply
≈ $69k – $145k per year (Estimated) • Hybrid • Full-Time • 6+ years exp • Egham • London
Apply
≈ $38k – $68k per year (Estimated) • Hybrid • Full-Time • London
QA
Rest-Assured
Apply
≈ $101k – $187k per year (Estimated) • Hybrid • Full-Time • PhD • London
Python
AI/ML
LLM
DevOps
Kubernetes
Apply
≈ $67k – $166k per year (Estimated) • Hybrid • Full-Time • London
DevOps
CI/CD
AWS
Amazon EC2
FinOps
Incident Management
Amazon S3
IAM
Amazon CloudWatch
Management
ITIL
Apply
See all jobs
This is one of many
1,581,627 more open roles from verified company boards, updated every day.