Senior Data Engineer (Data Platform DevOps & Architecture)
Confirmed on the employer's own hiring board on Oct 31, 2026. First seen by Alion on Aug 29, 2026.
Join our team as a Senior Data Engineer, where you'll lead the transformation of our analytics infrastructure into a modern Azure-based data platform. This permanent position focuses on building an automated, self-service architecture designed for continuous evolution. You'll work closely with product teams to align data capabilities with business objectives and mentor our team while building systems that adapt to emerging technologies. Enjoy a hybrid working environment, continuous development opportunities, and a fun workplace culture.
Missions
- Architect and implement a modern Azure-based data platform with DevOps principles, focusing on automation and continuous evolution.
- Establish automated engineering best practices for data governance and operations, and build robust batch and real-time processing pipelines.
- Mentor team members, drive continuous improvement, and translate business requirements into maintainable technical solutions.
Profil recherché
- You’ll bring 5+ years of data engineering experience with proven expertise in implementing enterprise-scale data platforms and DevOps methodologies- We need someone who prioritises maintainable, scalable, and adaptable systems
- Dimensional and relational data modeling expertise
- Medallion architecture implementation (bronze→silver→gold)
- Experience with PostgreSQL and SQL Server, including data replication/integration patterns for migration
- Microsoft Azure data stack expertise: ADF, Delta Lake, ADLS Gen2, Synapse, Databricks (with flexibility to integrate non-Microsoft solutions)
- Proficiency in Python and SQL for ELT/ETL pipelines
- CDC patterns and incremental load strategies at scale
- Batch, streaming, and micro-batching architectures
- Experience with Delta Change Data Feed or equivalent real-time sync mechanisms
- Experience building ingestion pipelines from diverse external APIs (CRM, analytics, finance, observability tools) into a unified lakehouse
- Performance tuning and cost optimisation
- Event-driven architectures and API integration patterns
- Azure networking and security best practices
- CI/CD with Azure DevOps or GitHub Actions
- Git version control proficiency
- Infrastructure as Code (Terraform preferred)
- Monitoring and alerting with Azure Monitor and Log Analytics
- Test automation for data pipelines (unit, integration, regression)
- Container orchestration (Kubernetes/AKS) experience beneficial
- GDPR/data protection implementation, including the right-to-be-forgotten
- Strong understanding of information security requirements
- Data lineage and quality enforcement
- RBAC, encryption strategies, and audit logging
- Experience with Microsoft Purview or similar governance frameworks
- Experience creating architecture diagrams, data flows, and runbooks
- Strong technical writing - please provide examples
- Clear presentation skills for technical and non-technical audiences
- Comfort working with product managers and translating between technical and business contexts
- Track record of training and upskilling teams
- Experience with structured project planning: from high-level initiatives through quarterly planning to executable tasks