Python Databricks Developer

Python Databricks Developer

Role Overview:

We are looking for a Python Databricks Developer with strong experience in data engineering, ETL development, and cloud-based data platforms. The candidate will be responsible for developing and optimizing data pipelines using Python, Databricks, and Apache Spark.

Key Responsibilities:

• Develop and maintain scalable data pipelines using Python, Databricks, and PySpark.

• Design and implement ETL/ELT workflows for large-scale data processing.

• Develop and optimize Databricks notebooks, jobs, and workflows.

• Work with Apache Spark for distributed data processing.

• Integrate data from multiple sources and build reliable data solutions.

• Perform data transformation, cleansing, validation, and optimization.

• Troubleshoot pipeline failures and performance issues.

• Collaborate with data engineers, analysts, and business stakeholders.

• Follow data quality, security, and development best practices.

Required Skills:

• Strong experience with Python and PySpark.

• Hands-on experience with Databricks.

• Good understanding of Apache Spark and distributed data processing.

• Strong SQL skills and experience with relational databases.

• Experience in ETL/ELT and data pipeline development.

• Knowledge of cloud platforms such as Azure, AWS, or GCP.

• Experience with Delta Lake and Databricks Workflows is preferred.

• Good problem-solving and communication skills.

Experience: 4-8 years

Role: Python Databricks Developer

Python,

SQL, Databricks, Apache Spark, REST APIs, Data Modeling, Git, Cache

development

Good to have - LLM Integration,