Lead Data Engineer

Job Description

• Skill Set :

  azure databricks

• Total Experience :

  8.00 to 12.00 Years

• No of Openings :

  1

• Job Post Date :

  09/11/2026

• Job Expiry Date :

  31/12/2026

• Domain :

  IT

• Location :

  WATERLOO [Canada]

• Job Reference No :

  4116155

Job Summary

This job posting is for an existing, active vacancy and we are looking to hire Lead Data Engineer as WFH (Canada only), who has experience in Python programming, PySpark, Azure Databricks, Spark SQL, DataFrames, Datasets, Real-time Data Streaming, Azure Data Services & Advanced SQL.

Role Overview

• 8-12 years of hands-on experience in software development, with a strong emphasis on Python programming.
• Deep expertise in PySpark for building and optimizing scalable data pipelines.
• Proficient in designing and implementing real-time data streaming solutions using Spark SQL, DataFrames, and Datasets.
• Solid experience with Azure Databricks, including working with Delta tables, workflows, and scripting in Python.
• Familiar with Azure cloud services, especially Azure Data Lake, Azure Data Factory, and EventHub or Kafka for streaming data ingestion.
• Skilled in writing complex SQL queries and building views involving joins across multiple tables.
• Experience across the Software Development Lifecycle (SDLC), with a strong grasp of Agile Scrum methodologies.
• Proficient in tools like Jira (project management), Confluence (documentation), and GitHub (version control and CI/CD pipelines).

Soft Skills & Collaboration:

• Strong collaboration mindset with enthusiasm for mobbing sessions and cross-team coordination.
• Excellent problem-solving and code review skills.
• Strong communication skills with the ability to understand business requirements and translate them into technical solutions.
• Proactive and responsive during business hours for any ad-hoc calls or meetings.
• Demonstrated ability to prioritize effectively, think creatively, and adapt quickly to new technologies and feedback.

The pay range for this role is $110,000 - $120,000* per annum including any bonuses or variable pay. Tech Mahindra also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience and location of the candidate.

AI tools may assist in the recruitment process; however, all hiring decisions are made by the recruitment team based on a comprehensive evaluation of candidates.

“Tech Mahindra is an Equal Employment Opportunity client. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin, or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities. Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at [email protected]