{"id":3110377,"url":"https://alion.io/job/plato-data-engineer-silver-conversions-and-scheduling","title":"Data Engineer- Silver Conversions and Scheduling","company":{"id":2149690,"name":"Plato","domain":"platoapp.com","url":"https://alion.io/company/platoapp","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Personio","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":null,"computed_at":"2026-10-26T05:57:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_company_offices","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["CA"],"hiring_countries_total":1,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Delta Lake","optional":false},{"name":"Git","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"pySpark","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-10-22T18:06:41Z","employer_posted_date":null,"last_verified_at":"2026-10-22T18:06:41Z","board_verified":false,"closed_at":null,"days_open":3,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":3},"description":"Who We ArePLATO is Canada’s largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients deliver reliable products that users enjoy interacting with.\nOur 100% Canada‑based team brings deep experience in QA, software testing, and IT services, along with a shared commitment to collaboration, mentorship, and continuous improvement. We’re a team that shows up for each other, whether that’s tackling complex client challenges or helping colleagues grow through coaching and knowledge‑sharing.\nAs Canada’s largest Indigenous‑owned software testing company, we’re proud of our roots and our mission to build a stronger, more inclusive technology workforce. At the same time, we warmly welcome applicants of all backgrounds and experiences who are passionate about quality, teamwork, and making an impact.\nDuration: December 2026- March 2027 (good likelihood of being extended)\nThe Opportunity:The Data Engineer will build Silver layer conversion and scheduling pipelines in the medallion Lakehouse on Microsoft Fabric. They will transform Bronze data into cleansed, conformed Silver datasets and orchestrate their execution reliably.\nSecurity Clearance requirement: Active Reliability and eligible for Secret clearance\nResponsibilities:Develop Silver layer conversion and transformation pipelines using Microsoft Fabric, Azure Data Factory, Spark and Delta Lake\nBuild and maintain scheduling and orchestration of Silver pipelines, including dependencies, retries and failure handling\nUse reusable PySpark libraries and metadata-driven configuration to speed up delivery\nApply standard error handling, logging, monitoring and unit-testing patterns\nSupport reconciliation, checkpointing, replay and recovery to maintain data integrity\nTune Spark workloads for performance and cost efficiency\nRequirements:Must have a minimum of 5 years of experience with the following:\nMicrosoft Fabric (Data Factory, Lakehouse), PySpark, Spark SQL, Delta Lake, Azure Data Factory, Azure Storage\n\nPipeline orchestration and scheduling (Fabric Data Factory / Azure Data Factory)\n\nPySpark and Spark SQL data transformation\n\nMicrosoft Purview exposure for cataloguing and lineage\n\n• Azure DevOps, Git, CI/CD pipelinesWork With UsAt PLATO, we believe that great work happens when people feel supported, connected, and challenged in the right ways. You’ll be part of a collaborative environment where experienced professionals share knowledge, mentor others, and contribute to solving complex, real‑world client projects.\nWe are committed to inclusive hiring practices and encourage applications from individuals of all backgrounds, including women, persons with disabilities, visible minorities, and Indigenous peoples. If you require accommodation at any stage of the recruitment process, we’re here to support you.\nPLATO respectfully acknowledges that we operate on treaty territories, unceded First Nations and Inuit territories, and within Métis homelands. We honour the long history of these lands and actively work toward reconciliation between Indigenous and non‑Indigenous peoples on Turtle Island.\nOriginally posted on Himalayas","description_format":"text","description_chars":3187,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":true,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Canada","iso":"CA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Messaging Apps"],"lifecycle":[{"event":"open","at":"2026-10-22T20:28:15Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":27,"reasons":["seen:3","velocity","win:early"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/plato-data-engineer-silver-conversions-and-scheduling","json_url":"https://alion.io/job/plato-data-engineer-silver-conversions-and-scheduling.json","meta":{"generated_at":"2026-10-26T17:12:56Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23083,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2149690},"rest":"https://alion.io/mcp/rest/get_company?id=2149690"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fplato-data-engineer-silver-conversions-and-scheduling"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fplato-data-engineer-silver-conversions-and-scheduling"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fplato-data-engineer-silver-conversions-and-scheduling"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/plato-data-engineer-silver-conversions-and-scheduling\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fplato-data-engineer-silver-conversions-and-scheduling"}]}