Confirmed on the employer's own hiring board on Nov 17, 2026. First seen by Alion on Nov 17, 2026.
Job Summary
We are seeking a highly experienced Senior / Lead Data Engineer with 12+ years of extensive experience in designing, architecting, developing, and optimizing enterprise-scale data platforms and complex data engineering solutions.
The ideal candidate will possess deep expertise in data architecture, large-scale data processing, cloud data platforms, ETL/ELT pipelines, data warehousing, and distributed computing. Strong hands-on experience with Google Cloud Platform (GCP) data engineering services is highly preferred.
The candidate will be responsible for driving technical architecture, defining data engineering best practices, leading complex data initiatives, and delivering secure, scalable, high-performance data solutions aligned with business and enterprise requirements.
Key Responsibilities
1. Data Architecture and Engineering Leadership
- Lead the architecture, design, and implementation of scalable, enterprise-grade data platforms and modern data architectures.
- Define technical strategies, architectural standards, and engineering best practices for batch and real-time data processing.
- Design robust data pipelines and data integration frameworks capable of handling large volumes of structured, semi-structured, and unstructured data.
- Drive data platform modernization, cloud migration, and legacy data warehouse transformation initiatives.
- Evaluate emerging technologies and recommend solutions based on scalability, performance, reliability, and cost efficiency.
- Having familiarity with Databricks would a good advantage
2. GCP Cloud Data Engineering - Preferred
- Design and implement end-to-end data engineering solutions using Google Cloud Platform.
- Develop and optimize data pipelines using BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, and Cloud Composer.
- Architect enterprise data warehouses and lakehouse solutions using GCP-native services.
- Implement scalable batch and streaming data processing frameworks.
- Optimize BigQuery performance, partitioning, clustering, query execution, and storage costs.
- Establish cloud data security, IAM, encryption, governance, monitoring, and operational standards.
- Lead data platform migration and modernization initiatives from on-premises or other cloud environments to GCP.
3. Advanced Data Pipeline Development
- Develop and maintain complex ETL/ELT frameworks using Python, SQL, PySpark, and distributed processing technologies.
- Design high-throughput, fault-tolerant, and resilient data pipelines with appropriate error handling and recovery mechanisms.
- Implement incremental data ingestion, CDC (Change Data Capture), data synchronization, and near-real-time processing.
- Build reusable frameworks and automation capabilities to improve development productivity and operational efficiency.
- Troubleshoot complex data processing issues and resolve performance bottlenecks across distributed systems.
4. Data Modeling and Performance Optimization
- Define enterprise data models, dimensional models, and scalable analytical data structures.
- Develop data transformation frameworks that support analytics, reporting, business intelligence, and advanced analytics use cases.
- Optimize SQL queries, distributed workloads, data storage, and compute resource utilization.
- Establish data quality, data lineage, metadata management, and data observability standards.
- Ensure data consistency, accuracy, availability, and reliability across the data lifecycle.
5. Technical Leadership and Collaboration
- Provide technical leadership and mentorship to data engineers and development teams.
- Review solution designs, architecture documents, code, and implementation approaches.
- Collaborate with enterprise architects, business analysts, analytics teams, and product stakeholders.
- Translate complex business requirements into scalable technical solutions.
- Drive engineering standards, CI/CD practices, automated testing, and infrastructure-as-code adoption.
Communicate technical decisions, delivery risks, and architectural recommendations to senior stakeholders
Skill Requirements
Data Architecture, GCP Cloud Data Engineering, ETL/ELT pipelines, data warehousing, and distributed computing.

