{"id":4110393,"url":"https://alion.io/job/49-solutions-senior-databricks-data-engineer","title":"Senior Databricks Data Engineer","company":{"id":670223,"name":"49 Solutions","domain":"49solutions.com","url":"https://alion.io/company/49solutions","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workable","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"contractor","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Ottawa, Canada"],"countries":["CA"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Copilot","optional":false},{"name":"Databricks","optional":false},{"name":"DataStage","optional":false},{"name":"Db2","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"GitHub","optional":false},{"name":"Oracle","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Teradata","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-11T23:17:22Z","employer_posted_date":"2026-11-11","last_verified_at":"2026-11-11T23:17:22Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"49 Solutions is proactively building a team of experienced, security-cleared professionals in preparation for anticipated Databricks initiatives within the Government of Canada. We are connecting with qualified candidates in advance so that we have a strong team ready to respond as relevant opportunities arise.\nPlease note that these opportunities are currently prospective and are not associated with a guaranteed placement or awarded contract. Candidates who join our network will be considered for relevant opportunities as they become available.\n49 Solutions is seeking Senior Databricks Data Engineers to design, develop and operationalize secure, scalable data pipelines and data products for Government of Canada environments using Databricks, Lakeflow, Delta Lake, Spark, Python and SQL.\nResponsibilities\nDesign, build and maintain enterprise data pipelines using Databricks.\nBuild ingestion and transformation processes using Lakeflow, Lakeflow Connect, Jobs and Auto Loader.\nDevelop batch and streaming solutions with Apache Spark and PySpark.\nImplement raw, cleaned and curated layers using Lakehouse and medallion patterns.\nDevelop and optimize Delta Lake tables and enterprise data products.\nConnect Databricks with cloud, enterprise and on-premises sources.\nModernize legacy ETL/ELT pipelines and data warehouse workloads.\nImplement data quality, validation, reconciliation, monitoring and Unity Catalog controls.\nDevelop reusable engineering patterns and participate in CI/CD and automated deployments.\nSupport testing, migration, production deployment, runbooks and client knowledge transfer.\nRequirements\nMandatory Qualifications\nA minimum of 10 years of professional experience working in the IT industry or performing IT-related roles.\nA valid and active Government of Canada Reliability, Secret or Top Secret security clearance.\nSignificant experience in data engineering, ETL/ELT or data integration.\nDemonstrated hands-on Databricks experience.\nStrong Python, SQL, Apache Spark and/or PySpark experience.\nExperience designing enterprise pipelines and cloud-based data platforms, preferably Azure.\nExperience with data quality, troubleshooting and performance optimization.\nExperience with Git and modern software development practices.\nTechnical Skills\nDatabricks\nLakeflow\nDelta Lake\nUnity Catalog\nApache Spark / PySpark\nPython\nSQL\nETL/ELT\nBatch and streaming processing\nMedallion architecture\nAzure data services\nGit and CI/CD\nAssets\nLakeflow Connect and Auto Loader\nTerraform or Databricks Asset Bundles\nAzure DevOps or GitHub\nMicrosoft Purview\nOn-premises source integration\nMigration from SAS, Synapse, DataStage, DB2, Oracle, SQL Server, Teradata or Netezza\nGovernment of Canada delivery experience\nBilingualism in English and French\nCertifications\nTarget Certification\nDatabricks Certified Data Engineer Professional.\nCandidates who do not currently hold the target certification may still be considered based on their experience. Candidates are not expected to obtain the certification immediately while 49 Solutions is building its prospective team. If a specific certification becomes required for an opportunity, candidates must be willing to obtain it at their own expense before being submitted for that opportunity.\nAdditional Asset Certifications\nDatabricks EDW/ETL migration training\nDatabricks Unity Catalog or data governance training\nRelevant Microsoft Azure data certifications\nAdditional advanced Databricks certifications\nSecurity Requirement\nCandidates must hold a valid and active Government of Canada Reliability, Secret or Top Secret security clearance.\nLocation\nOttawa, Ontario, Canada. Engagements may be remote, hybrid, or performed at a Government of Canada location. Candidates located in Toronto or Montreal are also encouraged to apply, provided they are willing and able to travel to Ottawa for onsite meetings approximately once per month, as required.\nWork arrangements will depend on the client, project and security requirements.\nUse of Artificial Intelligence and Applicant Privacy\nUse of Artificial Intelligence (AI tools):49 Solutions may use approved, secure, and private enterprise AI tools, including Microsoft 365 Copilot, to support recruitment and proposal activities. Information processed using our approved enterprise AI tools is not used to train public AI models or underlying foundation models. Personal contact information (address, email address and phone numbers) will be removed before uploading into the enterprise AI environment. Personal Information shall not be entered into public or consumer AI systems, and our use of enterprise AI is subject to applicable privacy requirements, including PIPEDA, as well as organizational security, retention, and deletion policies.\nBy submitting an application or CV to 49 Solutions, you consent to the collection and use of your information for staffing, recruitment, proposal, contracting and placement purposes.AI use for these purposes is optional. If you prefer that your CV not be processed using AI, please let us know. You can opt out of AI use and still apply for opportunities, remain in our candidate database, work with 49 Solutions, and be considered for current and future opportunities.\nConsent may be withdrawn at any time, subject to applicable legal, contractual, operational, and record-keeping requirements. For more information, our full Privacy Policy is available upon request.","description_format":"text","description_chars":5422,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":true,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Cloud Consulting & Migration"],"lifecycle":[{"event":"open","at":"2026-11-11T23:17:22Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":29,"reasons":["conf:2","win:early"],"computed_at":"2026-11-12T01:51:34Z"},"pay":null,"html_url":"https://alion.io/job/49-solutions-senior-databricks-data-engineer","json_url":"https://alion.io/job/49-solutions-senior-databricks-data-engineer.json","meta":{"generated_at":"2026-11-12T01:51:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":4248,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-13T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":670223},"rest":"https://alion.io/mcp/rest/get_company?id=670223"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2F49-solutions-senior-databricks-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2F49-solutions-senior-databricks-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2F49-solutions-senior-databricks-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/49-solutions-senior-databricks-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2F49-solutions-senior-databricks-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4110393}},{"tool":"search_jobs","arguments":{"company":"49solutions.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4110393},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}