Senior Data Engineer

We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers. You will work on modern data architectures, large-scale ETL/ELT systems, streaming pipelines, and AI-driven data platforms using Databricks, PySpark, Azure, and Kafka.

This role requires strong hands-on engineering expertise along with architecture thinking, production ownership, and customer-facing communication skills.

Role : Senior Data Engineer

Location : Bangalore or Pune (Hybrid)

Education : BE/BTech OR ME/MTech

Experience : 4+ Years

Key Responsibilities :

- Modernize legacy and non-scalable data architectures into cloud-native platforms

- Design and implement Medallion Architecture (Bronze, Silver, Gold) using Delta Lake and Databricks

- Build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks notebooks

- Develop and manage workflows using Databricks Workflows / Jobs

- Optimize Spark jobs for performance, scalability, and cost efficiency

- Implement data quality, governance, and lineage using DLT Expectations and Unity Catalog

- Build real-time and event-driven data pipelines using Kafka or similar streaming technologies

- Ensure platform reliability through monitoring, observability, and alerting

- Collaborate with global customers and cross-functional engineering teams

- Participate in architecture reviews, technical design, and best practice implementation

Required Skills :

- 4+ years of experience in Data Engineering / Big Data Engineering

- Strong hands-on experience with Databricks ecosystem

- Deep expertise in PySpark and distributed data processing

- Experience with Delta Lake, DLT, Unity Catalog, and Databricks Workflows

- Strong understanding of ETL/ELT pipelines and data modeling

- Experience with Azure Data Platform (ADLS, Azure services)

- Experience with Kafka or event-streaming platforms

- Good understanding of scalable distributed systems and event-driven architecture

- Strong problem-solving and analytical skills

- Excellent communication and stakeholder management skills

- Experience working with global customers in client-facing environments

Good to Have :

- Healthcare / HealthTech domain experience

- EHR/EMR migration projects

- FHIR, HL7, CDA standards

- HIPAA compliance exposure

- Experience with Patient 360 or Master Patient Index platforms

- AI-assisted development tool exposure

Why Join Us?

- Opportunity to work on cutting-edge AI and SaaS platforms

- Exposure to global customers across North America, EU, UAE, and Australia

- High ownership and fast growth environment

- Flexible work culture focused on outcomes

- Work alongside accomplished global engineering teams

- Opportunity to influence architecture, product, and business outcomes

Skills

Data Engineering, PySpark, Azure Databricks, Azure, Kafka, Medallion Architecture, Data Pipeline, ETL, Data Modeling