{"id":720902,"url":"https://alion.io/job/shyftlabs-senior-data-engineer","title":"Senior Data Engineer","company":{"id":685982,"name":"Shyftlabs","domain":"shyftlabs.io","url":"https://alion.io/company/shyftlabs","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Lever","truth_index":{"grade":"A","score":91,"open_postings":25,"ghost_share":0,"stale_share":0.36,"repost_share":0,"time_to_fill_p50_days":39,"computed_at":"2026-10-29T05:49:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Toronto, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":66000,"max_usd":118000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":90},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"GCP","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Airflow","optional":true},{"name":"Amazon Kinesis","optional":true},{"name":"Apache Kafka","optional":true},{"name":"dbt","optional":true},{"name":"Docker","optional":true},{"name":"Feature Store","optional":true},{"name":"Kubernetes","optional":true},{"name":"MLFlow","optional":true},{"name":"RAG","optional":true},{"name":"Snowflake","optional":true}],"status":"live","first_seen_at":"2026-07-28T14:34:27Z","employer_posted_date":"2026-07-28","last_verified_at":"2026-10-30T02:48:14Z","board_verified":true,"closed_at":null,"days_open":93,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":92},"description":"About ShyftLabs\nAt ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune 500 companies unlock growth with cutting-edge digital solutions that transform industries and create measurable business impact. We're growing fast, and we're looking for passionate technical leaders who are excited to solve complex data challenges, build modern cloud platforms, and deliver innovative solutions for enterprise clients.\nThe Opportunity\nShyftLabs is seeking an experienced Senior / Lead Data Engineer to lead the design, architecture, and delivery of enterprise-scale data platforms for Fortune 500 organizations. This is a highly client-facing leadership role responsible for owning projects from discovery through production deployment. You'll partner directly with client stakeholders to understand business objectives, define technical strategy, architect scalable cloud solutions, and lead engineering teams through successful delivery. The ideal candidate combines deep hands-on expertise with Databricks, Apache Spark, Python, SQL, and modern cloud platforms with proven experience leading complex data modernization initiatives. You'll play a key role in shaping technical direction, mentoring engineers, establishing engineering best practices, and delivering scalable data products that enable analytics, AI, and machine learning.\nWhat You'll Be Doing\nTechnical Leadership\nLead the architecture, design, and implementation of enterprise-scale data platforms from project inception through production deployment.\nOwn technical delivery across multiple client engagements while ensuring high-quality engineering standards.\nDefine solution architecture, technical roadmaps, and implementation strategies aligned with client business goals. \nConduct architecture reviews, code reviews, and establish engineering best practices across project teams.\nMentor and coach Data Engineers while fostering technical excellence and continuous learning.\nServe as the primary technical leader for complex engineering initiatives and critical project decisions.\nClient Partnership\nPartner directly with Fortune 500 clients to understand business requirements and translate them into scalable technical solutions.\nLead discovery workshops, architecture sessions, and technical planning meetings with both business and engineering stakeholders.\nPresent solution designs, delivery plans, and architectural recommendations to technical leadership and executive audiences.\nBuild trusted relationships with client teams while providing technical guidance throughout project execution.\nSupport pre-sales activities by contributing technical expertise, solution estimates, and implementation approaches when required.\nData Engineering & Platform Development\nDesign, develop, and optimize enterprise-grade data pipelines using the Databricks Unified Analytics Platform.\nBuild scalable ETL and ELT frameworks capable of processing large-scale structured and unstructured datasets.\nDesign and implement Lakehouse architectures using Delta Lake and Medallion design patterns.\nDevelop high-performance Spark applications for batch and real-time data processing.\nIntegrate data from enterprise applications, APIs, streaming platforms, and cloud storage solutions.\nEnsure data quality, integrity, and reliability through automated validation, testing, and monitoring.\nCloud & DevOps\nArchitect cloud-native data platforms across AWS, Azure, or Google Cloud Platform.\nImplement Infrastructure-as-Code using Terraform or similar technologies.\nBuild and maintain CI/CD pipelines supporting automated testing and deployment.\nOptimize cloud infrastructure for scalability, reliability, security, and cost efficiency.\nMonitor platform performance and proactively resolve operational issues.\nData Governance & Security\nImplement enterprise data governance frameworks and security best practices.\nConfigure Unity Catalog, metadata management, lineage, and role-based access controls.\nEnsure compliance with organizational security standards and regulatory requirements.\nPromote data observability and operational excellence across production environments\nCross-Functional Collaboration\nPartner closely with Product Managers, Data Scientists, Analytics Engineers, Machine Learning Engineers, and Software Engineers to deliver high-impact data products.\nEnable AI and machine learning initiatives through scalable feature engineering pipelines and production-ready datasets.\nContribute reusable frameworks, accelerators, and engineering standards that improve delivery across client engagements.\nWhat You'll Bring\nBachelor's or Master's degree in Computer Science, Data Engineering, Software Engineering, or a related technical discipline.\n8+ years of experience designing and building enterprise-scale data platforms.\n5+ years of hands-on experience with Databricks and Apache Spark.\nProven experience leading enterprise data engineering projects from architecture through production delivery.\nStrong expertise in Python, SQL, and Spark for large-scale data processing.\nDeep understanding of Delta Lake, Lakehouse architecture, and modern data platform design.\nExperience working with AWS, Azure, or Google Cloud Platform.\nStrong knowledge of ETL/ELT frameworks, distributed computing, and data modeling.\nExperience implementing CI/CD pipelines and Infrastructure-as-Code.\nStrong understanding of data governance, security, metadata management, and data quality practices.\nExperience optimizing distributed data processing workloads for performance and cost.\nExcellent communication and stakeholder management skills with experience working directly with enterprise clients. \nDemonstrated ability to mentor engineers and lead technical initiatives\nNice to Have\nDatabricks Certified Professional Data Engineer certification.\nExperience with Delta Live Tables, MLflow, Unity Catalog, and Databricks SQL.\nExperience with Kafka, Kinesis, Event Hubs, or other streaming technologies.\nHands-on experience with Snowflake, dbt, Airflow, or modern data orchestration tools.\nExperience with Kubernetes, Docker, and Terraform. \nKnowledge of AI/ML data platforms, Feature Stores, or Retrieval-Augmented Generation (RAG) architectures.\nPrevious consulting or professional services experience delivering solutions for enterprise clients.\nExperience within retail, e-commerce, financial services, logistics, healthcare, or ad-tech environments.\nSalary Range\n$140,000 - $180,000 (CAD)","description_format":"text","description_chars":6447,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[{"name":"Canada","iso":"CA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["AI Consulting & Integration"],"lifecycle":[{"event":"open","at":"2026-09-11T07:11:31Z"}],"visa":[],"liveness":{"score":18,"band":"cold","label":"Long shot","p_open":1,"p_active":0.633,"p_room":0.28,"age_days":92,"expected_fill_days":39,"reasons":["conf:0","velocity","win:tail","crowd:"],"computed_at":"2026-10-29T05:49:05Z"},"pay":null,"html_url":"https://alion.io/job/shyftlabs-senior-data-engineer","json_url":"https://alion.io/job/shyftlabs-senior-data-engineer.json","meta":{"generated_at":"2026-10-30T04:21:23Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":5858,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-31T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":685982},"rest":"https://alion.io/mcp/rest/get_company?id=685982"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fshyftlabs-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fshyftlabs-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fshyftlabs-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/shyftlabs-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fshyftlabs-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":720902}},{"tool":"search_jobs","arguments":{"company":"shyftlabs.io","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":720902},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}