Data Engineer
First seen by Alion on Aug 17, 2026.
Location : Remote / Hyderabad
Type : Full-Time
About the Role :
We are hiring a Data Engineer with strong, proven hands-on experience in both backend pipeline engineering and data reporting. You will be embedded directly with enterprise client teams across FinTech, HealthTech, and HighTech domains owning the full data stack from ingestion to insight. This is a dual-scope role designed for engineers who can build production-grade pipelines and surface clean, reliable data to business consumers.
Key Responsibilities :
Backend Pipeline Engineering :
- Design and build scalable data pipelines using Databricks, Apache Spark, and Python.
- Ingest, transform, and load data from diverse sources (APIs, databases, event streams).
- Manage and optimize cloud data warehouses Snowflake, BigQuery, Redshift.
- Build and maintain CI/CD pipelines for data workflows (Jenkins / Azure DevOps / GitHub Actions).
- Architect delta lake and lakehouse patterns for reliable, versioned data storage.
- Develop and maintain Infrastructure as Code (Terraform / CloudFormation).
Data Reporting & Analytics :
- Design and build analytics-ready data models and reporting layers.
- Develop dashboards and reports using Power BI, Tableau, or Looker.
- Write complex SQL for transformation, aggregation, and performance tuning.
- Translate business stakeholder requirements into clean data solutions.
- Maintain data quality frameworks, lineage docs, and governance standards.
- Support customer-facing reporting integrations and SLA-driven data delivery.
Required Skills & Experience :
- 5 to 8 years of hands-on experience in data engineering or analytics engineering.
- Databricks production-grade Delta Lake, Spark, notebooks, jobs.
- Python & SQL strong proficiency; PySpark, pandas, complex SQL transformations.
- Cloud Platforms AWS (Glue, EMR, S3, Redshift) and/or Azure (ADF, ADLS, Synapse) and/or GCP (BigQuery, Dataflow).
- Data Warehousing Snowflake, BigQuery, or Redshift modelling, optimization, cost management.
- CI/CD & DevOps Git, Jenkins, Azure DevOps, or GitHub Actions for pipeline deployment.
- Reporting Tools Power BI, Tableau, or Looker dashboard development and data modelling.
- Kafka / Streaming event-driven pipeline experience is a strong plus.
- Terraform infrastructure provisioning for data platforms.
- Communication work directly with clients and translate business needs into data solutions.
Nice to Have :
- Databricks Certified (Associate or Professional).
- Experience with dbt (data build tool) for transformation layer.
- Exposure to Airflow or Prefect for orchestration.
- Familiarity with data mesh or data contract patterns.
- Prior experience in a client-embedded or consulting delivery model.
Skills
Data Engineering, Azure Databricks, Apache Spark, Python, SQL, Snowflake DB, Power BI, Tableau