{"id":2123768,"url":"https://alion.io/job/dataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric","title":"Senior Data Quality Engineer, SDET with Databricks and Microsoft Fabric","company":{"id":46984,"name":"DataArt","domain":"dataart.com","url":"https://alion.io/company/dataart-com","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":["Wrocław, Poland","Warsaw, Poland","Lublin, Poland","Kraków, Poland","Łódź, Poland"],"countries":["PL"],"hiring_countries":["PL"],"hiring_countries_total":1,"salary":{"min":18000,"max":21500,"currency":"PLN","period":"month","gross":null,"usd_annual":66000},"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Microsoft Fabric","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"AWS","optional":true},{"name":"C#","optional":true},{"name":"GCP","optional":true},{"name":"Great Expectations","optional":true},{"name":"Playwright","optional":true},{"name":"Selenium","optional":true}],"status":"live","first_seen_at":"2026-10-08T11:05:14Z","employer_posted_date":null,"last_verified_at":"2026-10-08T11:05:14Z","board_verified":false,"closed_at":null,"days_open":11,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":11},"description":"Technology stack\nPython, SQL Server, Azure Databricks, Microsoft Fabric, Azure DevOps, dbt tests, Power BI\nClient\nOur client is a UK financial services group operating in a highly regulated environment, currently rebuilding its data and analytics capability as part of a wider platform modernisation programme.\nProject overview\nThe project migrates data and reporting from a legacy estate onto a modern platform built on Databricks and Microsoft Fabric. Quality engineering is central to the project. The business needs confidence that migrated data reconciles with the source, that pipelines behave as specified, and that reports produce consistent results.\nPosition overview\nThis is a data focused quality engineering role rather than an application testing role. You will build automated validation for data pipelines and data products, own reconciliation testing between legacy and target systems, and put quality gates into the delivery pipeline so that a failure blocks a release rather than producing a report that nobody reads.\nResponsibilities\nDesign and implement data testing and quality assurance frameworks.\n\nBuild automated validation for data pipelines and data products.\n\nOwn source to target reconciliation between legacy systems and the new platform.\n\nBuild repeatable regression packs that run unattended.\n\nWrite unit tests that execute automatically within CI/CD, with quality gates that can block a release.\n\nDetect and handle schema drift and unexpected structural changes.\n\nValidate reports, dashboards, and semantic models, including measure definitions, filter behaviour, and totals.\n\nApply AI assisted techniques to test generation and coverage analysis, with human review.\n\nRequirements\n5+ years of experience in quality engineering, with meaningful recent experience testing data or ETL processes rather than applications.\n\nStrong Python and SQL skills, used for building test automation rather than only running it.\n\nExperience with pipeline validation, including row counts, control totals, referential integrity, and business rule assertions.\n\nExperience with source to target reconciliation using defined tolerances.\n\nExperience with test automation within CI/CD, including gates that block a release.\n\nExperience with Azure DevOps.\n\nExperience with SQL Server.\n\nEnglish proficiency at a level suitable for direct client conversations.\n\nNice to have\nExperience with Azure Databricks or Microsoft Fabric.\n\nExperience with data quality frameworks, including Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, or Deequ.\n\nExperience designing a test framework from scratch rather than extending an existing one.\n\nExperience testing semantic models and BI layers.\n\nExperience working in a regulated financial services environment.\n\nExperience with application test automation alongside data testing, including Selenium, C#, SpecFlow, or Playwright.\n\nWhat We Offer:\nVacation days: Up to 26 business days per year.\n\n10 illness/special days off per year (fully paid, no medical papers needed) for all contract types\n\nHealth and life insurance (Luxmed)\n\nMyBenefit platform with Multisport option\n\nInternal psychological support service\n\nEnglish language classes from the first working day\n\nAccess to external learning platforms: O’Reilly, LinkedIn Learning, Udemy, and a wide catalog of diverse internal training\n\nFlexible workplace: work from the office, from home, or choose a hybrid option\n\nTech Skills Mentoring Program\n\nOpportunities to develop as a public speaker, mentor, or technical interviewer\n\nFully paid idle (bench) when not involved in a project\n\nCertification reimbursement (AWS, GCP, Microsoft, etc.)\n\nTech stack\nDatabricks\nPython\nSQL\nETL\nAzure DevOps\nSQL Server\nCI/CD","description_format":"text","description_chars":3737,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Certification reimbursement","Flexible schedule","Life insurance"],"hiring_locations":[{"name":"Poland","iso":"PL","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Outsourcing & Dedicated Teams","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-10-08T23:50:21Z"}],"visa":[],"liveness":{"score":78,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.868,"p_room":0.9,"age_days":11,"expected_fill_days":30,"reasons":["seen:11","velocity","win:mid"],"computed_at":"2026-10-20T05:45:00Z"},"pay":{"stated_usd_annual":66000,"is_top_pay":false},"html_url":"https://alion.io/job/dataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric","json_url":"https://alion.io/job/dataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric.json","meta":{"generated_at":"2026-10-20T10:01:50Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10978,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":46984},"rest":"https://alion.io/mcp/rest/get_company?id=46984"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/dataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdataart-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric"}]}