566,730open jobs
22,876companies
77,553added this week
Browse all
Salary
$100k – $140k per year
Location
Remote/Hybrid (Toronto, Canada)
Seniority
Senior · 5+ years exp
Employment
Full-Time
Overview
Company
Impact
Profile match

About ShyftLabs

At ShyftLabs, we live and breathe data. Since 2020, we’ve been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable business impact. We’re growing fast and we’re looking for passionate problem-solvers who are ready to turn big ideas into real outcomes.

The Opportunity

ShyftLabs is seeking a skilled Data Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven insights and ensure scalable, high-performance data architectures.

What You'll Be Doing

  • Design, implement, and optimize big data pipelines in Databricks.

  • Develop scalable ETL workflows to process large datasets.

  • Leverage Apache Spark for distributed data processing and real-time analytics.

  • Implement data governance, security policies, and compliance standards.

  • Optimize data lakehouse architectures for performance and cost-efficiency.

  • Collaborate with data scientists, analysts, and engineers to enable advanced AI/ML workflows.

  • Monitor and troubleshoot Databricks clusters, jobs, and performance bottlenecks.

  • Automate workflows using CI/CD pipelines and infrastructure-as-code practices.

  • Ensure data integrity, quality, and reliability in all pipelines.

What You Bring

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.

  • 5+ years of hands-on experience with Databricks and Apache Spark.

  • Proficiency in SQL, Python, or Scala for data processing and analysis.

  • Experience with cloud platforms (AWS, Azure, or GCP) for data engineering.

  • Strong knowledge of ETL frameworks, data lakes, and Delta Lake architecture.

  • Experience with CI/CD tools and DevOps best practices.

  • Familiarity with data security, compliance, and governance best practices.

  • Strong problem-solving and analytical skills with an ability to work in a fast-paced environment.

Nice to Have

  • Databricks certifications (e.g., Databricks Certified Data Engineer, Spark Developer).

  • Hands-on experience with MLflow, Feature Store, or Databricks SQL.

  • Exposure to Kubernetes, Docker, and Terraform.

  • Experience with streaming data architectures (Kafka, Kinesis, etc.).

  • Strong understanding of business intelligence and reporting tools (Power BI, Tableau, Looker).

  • Prior experience working with retail, e-commerce, or ad-tech data platforms.

Salary Range

  • $100,000 - $140,000
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
566,730 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

Similar stack
Same company
Toronto
$51k – $138k per year (Estimated) • In office • Full-Time • 3+ years exp • Bachelor's Degree • Kilkenny
Python
SQL
Databases
Snowflake
Databricks
Delta Lake
Apache Kafka
AI/ML
LangGraph
AutoGen
LangChain
Spark
Prompt Engineering
AI Agents
Semantic Kernel
CrewAI
RAG
Semantic Search
LLMOps
Human-in-the-Loop
Semantic Search
LLM Guardrails
Agentic Workflows
Multi-Agent Systems
DevOps
Vector
Apply
$39k – $89k per year (Estimated) • In office • Full-Time • 4+ years exp • Buenos Aires
Python
SQL
Databases
Snowflake
Google BigQuery
Amazon Redshift
BigQuery
AI/ML
Scikit-learn
Pandas
NumPy
Time Series Forecasting
Analytics
Tableau
Power BI
Seaborn
Matplotlib
Looker
Apply
$74k – $157k per year (Estimated) • In office • Full-Time • 3+ years exp • Bachelor's Degree • Kilkenny
Python
SQL
Databases
Databricks
Analytics
Power BI
ETL/ELT
Management
Agile
Scrum
Apply
$60k – $146k per year (Estimated) • In office • Full-Time • 5+ years exp • Bachelor's Degree • Kilkenny
Python
JavaScript
TypeScript
Node JS
Python
Flask
FastAPI
pySpark
Databases
Amazon Aurora
AI/ML
Spark
NLP
Frontend
GraphQL
React.js
DevOps
Azure
CI/CD
AWS
Docker
Kubernetes
AWS Lambda
Amazon EC2
Amazon S3
IAM
Management
Agile
Scrum
Apply
$8k – $20k per year (Estimated) • In office • Full-Time • Master's Degree • Hangzhou
Python
MATLAB
Apply
$56k – $126k per year (Estimated) • Remote/Hybrid • Full-Time • 4+ years exp • Toronto
Python
PowerShell
DevOps
Rest API
Terraform
GCP
IAM
Cybersecurity
Okta
Zero Trust
Least Privilege
Microsoft Entra ID
Apply
$20k – $47k per year (Estimated) • In office • Full-Time • 4+ years exp • Bachelor's Degree • Noida
Python
Java
SQL
Apply
$69k – $133k per year (Estimated) • Remote/Hybrid • Full-Time • 7+ years exp • Toronto
DevOps
Incident Management
Apply
$27k – $59k per year (Estimated) • Remote/Hybrid • Full-Time • 9+ years exp • Coimbatore
Python
SQL
Python
pySpark
Databases
Databricks
Delta Lake
Apache Kafka
AI/ML
Spark
Airflow
dbt
DevOps
Rest API
CI/CD
Git
AWS
Amazon S3
Analytics
ETL/ELT
Dimensional Modeling
Apply
$112k – $196k per year (Estimated) • Remote/Hybrid • Full-Time • 8+ years exp • Toronto
Databases
Snowflake
Databricks
Google BigQuery
BigQuery
AI/ML
Spark
Model Context Protocol
LLM
RAG
Agentic Workflows
DevOps
GCP
Azure
AWS
Apply
$81k – $181k per year (Estimated) • In office • Full-Time • 12+ years exp • Toronto
SQL
Databases
Snowflake
DevOps
Azure
Apply
$93k – $178k per year (Estimated) • In office • Full-Time • 10+ years exp • Toronto
Apply
$56k – $58k per year • In office • Part-Time • Toronto
Apply
$48k per year • In office • Part-Time • 1+ year exp • Toronto
Apply
$34k – $58k per year (Estimated) • In office • Part-Time • 1+ year exp • PhD • Toronto
Apply
See all jobs
This is one of many
566,730 more open roles from verified company boards, updated every day.