Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 19, 2026.
Data and Integration Engineer - AI
6-12 month contract (dependent on business need)
Any HMRC Regional Centre across the United Kingdom
Competitive Day Rate
Role overview
Assess data readiness and access, connect trusted knowledge sources and operational systems, and develop the pipelines, APIs, retrieval and integration patterns required by AI propositions.
Job description
You will provide the data and integration engineering that enables AI propositions to use reliable, authorised and well-governed information. You will assess candidate data and knowledge sources, resolve access and quality issues, and build secure connections between AI components and enterprise systems.
You will create repeatable ingestion, transformation, retrieval and API patterns that support prototypes while providing a credible route to scale and live operation. You will work closely with data owners, architects, AI engineers, cyber security and service teams to ensure lineage, permissions, quality and operational responsibilities are understood.
- Assess the readiness, quality, ownership, sensitivity, permissions and technical accessibility of data and knowledge sources.
- Define data contracts, schemas, metadata, lineage and validation rules for AI use cases.
- Build and maintain ingestion and transformation pipelines for structured, semi-structured and unstructured content.
- Develop secure APIs, events, connectors and integration services linking AI components to operational systems.
- Implement retrieval pipelines including parsing, chunking, enrichment, embeddings, indexing, vector search, filtering and ranking.
- Apply data minimisation, retention, access control, audit and privacy requirements throughout the engineering lifecycle.
- Automate testing and monitoring for data quality, freshness, pipeline reliability, integration failures and service performance.
- Diagnose and resolve data, interface and retrieval issues across distributed systems.
- Create reusable patterns, code, documentation and deployment guidance for other teams.
- Support handover to platform, product and service teams, including runbooks, ownership, support and change arrangements.
Person specification
A senior data engineer with strong integration skills and a practical understanding of how data quality, access control and retrieval affect AI outcomes. You will be comfortable exploring unfamiliar data estates, designing robust pipelines and APIs, and communicating constraints and options to both technical teams and data owners.
Essential criteria
The successful contractor will be able to demonstrate the following essential experience and capability:
- Experience in AI engineering.
- Proven data engineering experience designing and operating ingestion, transformation and processing pipelines across structured and unstructured data.
- Strong experience designing and implementing APIs and system integrations, including authentication, error handling, versioning and monitoring.
- Hands-on experience with retrieval technologies for AI, such as document processing, embeddings, vector databases, hybrid search, metadata filtering or ranking.
- Experience using Python, SQL and modern engineering practices including source control, automated testing and continuous integration and delivery.
- Strong understanding of data modelling, data quality, metadata, lineage and data governance in a large or regulated organisation.
- Experience implementing security, privacy and access controls for sensitive data and integrating with enterprise identity and secrets-management services.
- Ability to assess data readiness, explain constraints and trade-offs, and work effectively with data owners, architects, engineers and operational teams.

