Data Engineer

Role : Databricks Data Engineer 4 to 18 Years

Location : Bangalore / Pune / Mumbai / Kolkata / Delhi / Hyderabad / Bhubaneswar / Coimbatore

Experience : 4 to 18 Years

Work Mode : Hybrid

Notice Period : Immediate Joiners to 30 Days preferred

About the Role :

We are looking for experienced Databricks Data Engineers to design, develop and optimize scalable data engineering solutions using Databricks and modern cloud data platforms.

The ideal candidate should have strong experience in Databricks, Apache Spark/PySpark, SQL and cloud-based data engineering.

Key Responsibilities :

- Design and develop scalable data pipelines using Databricks.

- Develop data processing solutions using Apache Spark / PySpark.

- Build and optimize ETL/ELT pipelines for large-scale datasets.

- Work with cloud storage and data lake architectures.

- Develop data ingestion and transformation frameworks.

- Implement data quality, validation and monitoring processes.

- Optimize Spark jobs and data pipelines for performance and scalability.

- Work with structured and semi-structured data.

- Develop solutions using SQL and Python.

- Implement Delta Lake-based data solutions where applicable.

- Work with cloud platforms such as AWS, Azure or GCP.

- Collaborate with data architects, analysts and business stakeholders.

- Troubleshoot production issues and ensure reliable data pipelines.

- Follow CI/CD, Git and data engineering best practices.

Must-Have Skills :

- 4+ years of experience in Data Engineering.

- Strong hands-on experience with Databricks.

- Strong experience with Apache Spark / PySpark.

- Strong Python and SQL skills.

- Experience building ETL/ELT data pipelines.

- Strong understanding of data lakes and data warehousing.

- Experience working with large datasets and distributed data processing.

- Good understanding of data modeling and data transformation.

Good to Have :

- Experience with Delta Lake.

- Databricks Workflows / Jobs.

- Databricks SQL.

- Experience with AWS / Azure / GCP.

- Experience with Kafka or other streaming technologies.

- Experience with CI/CD and DevOps.

- Knowledge of data governance and data quality.

- Databricks certification.

Education :

B.E / B.Tech or equivalent qualification.

What We're Looking For :

Strong problem-solving ability, excellent communication skills and the ability to work effectively with technical and business teams in a client-facing environment.

Skills

Data Engineering, Azure Databricks, Apache Spark, Python, SQL, Cloud, ETL, DataLake, Data Ingestion, Data Governance, Data Quality