Solutions Architect - Databricks - Data Engineering
First seen by Alion on Oct 27, 2026.
Role Overview:
As a Databricks Solutions Architect, you will serve as the technical cornerstone for our data engineering initiatives, bridging the gap between complex business requirements and scalable cloud infrastructure. You will work closely with cross-functional engineering teams, product managers, and key stakeholders to design and implement robust data platforms on AWS and Azure. Your day-to-day will involve architecting end-to-end data pipelines, optimizing Apache Spark workloads, and ensuring the seamless integration of data lakes to drive actionable business intelligence. By leading the technical strategy for our data ecosystem, you will directly influence our ability to process petabyte-scale data, ultimately enabling faster decision-making and superior customer experiences across our global operations in Noida and Bhopal.
Key Responsibilities:
- Architect and deploy scalable data solutions on Databricks, AWS, and Azure to ensure high availability and performance for enterprise-level data processing.
- Lead the design of complex ETL/ELT pipelines and data modeling strategies that streamline data ingestion and transformation for downstream analytics.
- Collaborate with engineering teams to migrate legacy systems to cloud-native architectures, ensuring minimal downtime and maximum data integrity.
- Implement Infrastructure as Code (IaC) using Terraform to automate the provisioning of cloud environments, reducing manual overhead and configuration drift.
- Mentor junior data engineers and developers by establishing best practices in Python and SQL coding standards to maintain a high-quality codebase.
- Partner with business stakeholders to translate ambiguous requirements into technical specifications that align with long-term organizational data goals.
Required Skillset:
- Demonstrated expertise in architecting and managing large-scale data lakes and lakehouse architectures using Databricks within AWS and Azure environments.
- Advanced proficiency in Apache Spark, Python, and SQL, with a proven ability to optimize complex queries and distributed computing workloads for cost and speed.
- Strong command over cloud infrastructure automation using Terraform, ensuring secure and repeatable deployments across multi-cloud environments.
- Exceptional communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders and influence senior leadership decisions.
- Proven ability to thrive in a hybrid work environment, balancing independent architectural design with collaborative team-based problem solving across our Noida and Bhopal offices.
- A Bachelor's or Master's degree in Computer Science, Information Technology, or a related quantitative field, supported by 8 - 12 years of relevant professional experience.
Skills
Data Engineering, Databricks, Apache Spark, AWS, Azure, Python, SQL, Terraform, ETL