Data Engineer/Senior Data Engineer/Lead/Architect

Location: Irving, TX / Chicago, IL / Edina, MN / Philadelphia, PA / Portland, OR

Work Arrangement: Hybrid – 3 days onsite per week (Tuesday, Wednesday & Thursday)

Duration: Long-Term Contract

Important Note

Interested candidates are requested to include their LinkedIn profile URL/ID on their resume.

Must-Have Skills

• Azure Databricks
• Azure Data Lake Storage (ADLS Gen2)
• Azure Data Factory (ADF)
• PySpark
• Python
• SQL
• Delta Lake / Lakehouse Architecture
• ETL/ELT Development
• Data Modeling
• Azure Cloud Platform
• Git & CI/CD
• Agile/Scrum

Key Requirements

• 7+ years of experience in Data Engineering
• 5+ years of hands-on experience with Azure Data technologies
• 2+ years of experience in the Healthcare, Managed Care, or Payer domain
• Proven experience building enterprise-scale data pipelines and data integration solutions
• Strong understanding of Data Warehousing, Data Lakes, and Lakehouse architectures
• Hands-on experience processing large-scale structured and unstructured datasets
• Strong experience designing scalable and high-performance data solutions

Preferred Qualifications

• Experience working with healthcare data, including:
  • Claims
  • Membership
  • Provider
  • Care Management
• Power BI
• FHIR / HL7
• Azure DevOps & Infrastructure as Code (IaC)
• AI/ML data pipelines

Primary Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines
• Build data ingestion and transformation frameworks using Azure data services
• Develop scalable data processing solutions using Azure Databricks and PySpark
• Implement and maintain Delta Lake and Lakehouse architectures
• Develop data models to support analytics and business requirements
• Ensure data quality, governance, monitoring, security, and performance
• Troubleshoot and optimize data pipelines and processing workloads
• Support cloud migration, modernization, and data platform transformation initiatives
• Implement CI/CD practices for data engineering workflows
• Collaborate with business, analytics, product, and technology teams in Agile/Scrum environments

Ideal Candidate Profile

We are looking for a Senior Data Engineer / Lead / Architect with strong hands-on experience in Azure Databricks, ADF, ADLS Gen2, PySpark, Python, SQL, Delta Lake, and Lakehouse architecture, along with proven experience in the Healthcare/Managed Care/Payer domain.