Databricks Developer

We are looking for a skilled and motivated Databricks Developer to join our team and contribute to cloud-based data engineering initiatives in the healthcare domain. The ideal candidate will have hands-on experience developing and maintaining data pipelines using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory.

The role involves transforming raw data into reliable, high-quality datasets to support clinical operations, enterprise data warehousing, analytics, and reporting. The successful candidate will work closely with data engineers, architects, and business stakeholders to develop scalable data solutions while ensuring data quality, security, and governance.

Key Responsibilities

• Develop, test, and maintain ETL/ELT data pipelines using Azure Databricks, PySpark, Spark SQL, and Databricks notebooks.
• Build and optimise data ingestion and transformation workflows using Azure Data Factory (ADF) and Databricks Workflows/Jobs.
• Implement and maintain Delta Lake tables and Medallion architecture (Bronze, Silver, and Gold layers).
• Integrate data from multiple sources, including SQL databases, REST APIs, SFTP, and file-based systems, into Azure Data Lake Storage (ADLS Gen2).
• Support the development and enhancement of Enterprise Data Warehouse (EDW), data lakehouse, and data mart solutions.
• Develop and maintain conceptual, logical, and physical data models to support analytics, reporting, and business requirements.
• Perform data profiling, cleansing, validation, reconciliation, and quality checks to ensure data accuracy and consistency.
• Apply data governance, metadata management, and data lineage practices to maintain traceability and auditability.
• Write and optimise SQL queries and data transformations for improved pipeline performance.
• Collaborate with technical, clinical, and business teams to translate requirements into effective data engineering solutions.
• Follow coding standards, participate in code reviews, and support unit, integration, and regression testing.
• Support version control, CI/CD processes, and automated deployment practices.
• Assist in preparing datasets for AI/ML workflows and integrating analytical outputs into data pipelines when required.
• Follow applicable data security, privacy, and regulatory requirements, including HIPAA and GDPR, where relevant.

Required Qualifications & Experience

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, Software Engineering, or a related field.
• 2–4 years of hands-on experience developing cloud data engineering solutions using Azure Databricks, PySpark, and Spark SQL.
• Experience building and maintaining ETL/ELT pipelines for data warehousing, data lakes, or data marts.
• Practical knowledge of Azure Data Factory, Databricks Workflows/Jobs, and Azure Data Lake Storage Gen2.
• Experience working with Delta Lake, including Delta tables, schema evolution, and performance optimisation.
• Strong SQL skills and understanding of relational database design, data modelling, normalisation, and denormalisation.
• Experience integrating data from multiple sources, including SQL Server, REST APIs, and file-based storage.
• Understanding of data quality, validation, metadata management, data lineage, and governance practices.
• Familiarity with Git, version control, code reviews, and basic CI/CD practices.
• Good analytical, problem-solving, communication, and collaboration skills.

Preferred Skills

• Experience working with healthcare data or healthcare analytics platforms.
• Familiarity with healthcare standards and terminologies such as HL7, FHIR, OMOP, CDISC, SNOMED CT, LOINC, ICD-10, or RxNorm.
• Exposure to Azure Synapse Analytics, Azure SQL Database, Databricks SQL, or Azure Blob Storage.
• Understanding of healthcare data privacy and compliance requirements.
• Exposure to AI/ML workflows, Azure Machine Learning, or preparation of datasets for model training.
• Familiarity with Unity Catalog, data governance frameworks, and data modelling tools such as ER/Studio or ERwin.

Required Skills & Competencies

• Strong written and verbal communication skills.
• Ability to translate business and technical requirements into practical data solutions.
• Effective teamwork and stakeholder coordination skills.
• Strong attention to detail and commitment to data quality.
• Ability to manage priorities, meet deadlines, and adapt to changing requirements.
• Willingness to learn, receive feedback, and continuously improve technical capabilities.

• Job level: Mid Level
• Employment type: Full Time
• Experience: More than 2 years
• Education: Under Graduate (Bachelor)
• Skills: Microsoft Azure, Data Migration, Data Management, Database Design, databricks
• Salary: NRs. 1,800,000 - 2,400,000 yearly
• Job location: Mid Baneshwor
• Apply before: 2026-11-14