{"id":3559526,"url":"https://alion.io/job/mars-dataops-engineer","title":"DataOps Engineer","company":{"id":94439,"name":"Mars","domain":"mars.com","url":"https://alion.io/company/mars","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Workday","truth_index":{"grade":"B","score":81,"open_postings":64,"ghost_share":0,"stale_share":0.969,"repost_share":0,"time_to_fill_p50_days":17,"computed_at":"2026-11-06T05:58:05Z"}},"role":"Data Science","role_family":"Data Science","seniority":"middle","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Warsaw, Poland","Brazil"],"countries":["PL","BR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":33000,"max_usd":88000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":1015},"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Git","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"dbt","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-10-01T00:00:00Z","employer_posted_date":"2026-10-01","last_verified_at":"2026-11-06T16:36:24Z","board_verified":true,"closed_at":null,"days_open":36,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":36},"description":"Job Description:\nAt Mars Data Platform Services (DPS), we are transforming our enterprise data platform across Azure Databricks and Unity Catalog into an automated, self-service product. Instead of hand-building custom pipelines for every new dataset, we are engineering an intelligent, metadata-driven ingestion engine that configures and scales pipelines automatically.\nWe are looking for a DataOps Engineer to lead the technical evolution of our data inflow and landing zone ecosystem. In this role, you will build the central framework that turns pipeline creation, data onboarding, storage provisioning, and data archiving into automated, configuration-driven processes.\nWhat Will Be Your Key Responsibilities?\n1. Build & Scale the Metadata-Driven Ingestion Engine\nDesign and enhance our central metadata framework so onboarding new data sources requires simple configuration updates rather than writing new pipeline code. Ensure the engine dynamically orchestrates data ingestion, schema evolution, and merge logic reliably across the platform.\n2. Lead Landing Zone Reliability & Data Quality Safeguards\nDesign and maintain high-throughput landing zones across cloud storage and Unity Catalog. Build automated safeguards that isolate schema errors or corrupted data into quarantine areas and dead-letter queues before they can impact production data tables.\n3. Automate Unity Catalog Assets & Long-Term Archiving\nAutomate the programmatic creation and setup of storage locations, schemas, and tables in Unity Catalog. Implement automated lifecycle policies that handle time-based data retention and migrate older data into low-cost archival storage seamlessly.\n4. Champion DataOps Standards & Operational Enablement\nDrive modern software engineering standards into our data workflows through automated CI/CD testing and deployment. Create reusable deployment templates, monitoring dashboards, and clear operational playbooks that empower our 24/7 support teams to monitor and maintain pipelines with confidence.\nWhat Are We Looking For?\nEssential Requirements:\nCore Data Engineering Background: 4+ years of hands-on data engineering experience building reliable batch and streaming data pipelines using Python/PySpark, SQL, and cloud data warehouses or lakehouses (Azure Databricks / Delta Lake).\nMetadata-Driven Mindset: Proven track record designing or maintaining config-driven/metadata-driven frameworks where pipeline generation, schema creation, Delta merge logic, and scheduling are driven dynamically by central control tables rather than hand-coded per dataset.\n Programmatic Unity Catalog & Landing Zone Architecture: Practical expertise managing and provisioning Databricks Unity Catalog storage assets (Volumes, External Locations, Managed/External Tables) programmatically via code/APIs, alongside high-throughput Azure Data Lake Storage (ADLS Gen2) landing zones.\n DataOps & Automation Practices: Experience treating data pipelines like software products-applying automated CI/CD deployment, version control (Git), automated testing, and modular packaging (such as Databricks Asset Bundles or Terraform).\nNice-to-Haves:\nExperience with declarative pipeline tools (such as Delta Live Tables or dbt).\nPractical experience designing automated data retention schedules and long-term cloud archival storage.\nFamiliarity with supporting or partnering with operational support teams and Managed Service Providers (MSPs","description_format":"text","description_chars":3431,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"Brazil","iso":"BR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Pet Food, Supplies & Care","Confectionery"],"lifecycle":[{"event":"open","at":"2026-10-31T03:05:23Z"}],"visa":[],"liveness":{"score":16,"band":"cold","label":"Long shot","p_open":1,"p_active":0.469,"p_room":0.35,"age_days":36,"expected_fill_days":17,"reasons":["conf:4","stale_co","velocity","win:tail","comp:brand"],"computed_at":"2026-11-06T05:58:05Z"},"pay":null,"html_url":"https://alion.io/job/mars-dataops-engineer","json_url":"https://alion.io/job/mars-dataops-engineer.json","meta":{"generated_at":"2026-11-06T20:48:53Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":337,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":94439},"rest":"https://alion.io/mcp/rest/get_company?id=94439"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fmars-dataops-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fmars-dataops-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fmars-dataops-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/mars-dataops-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fmars-dataops-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3559526}},{"tool":"search_jobs","arguments":{"company":"mars.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3559526},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}