{"id":3850467,"url":"https://alion.io/job/indicium-ai-senior-data-engineer-data-ai","title":"Senior Data Engineer (Data & AI)","company":{"id":2826334,"name":"Indicium AI","domain":"indicium.ai","url":"https://alion.io/company/indicium-ai","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"InHire","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":[],"countries":[],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Anthropic","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure DevOps","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"FinOps","optional":false},{"name":"OpenAI","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Time Series","optional":false},{"name":"Unity","optional":false},{"name":"Agile","optional":true},{"name":"dbt","optional":true},{"name":"Delta Lake","optional":true},{"name":"ISO 27001","optional":true},{"name":"Microsoft Entra ID","optional":true},{"name":"MQTT","optional":true},{"name":"OPC UA","optional":true},{"name":"Power BI","optional":true},{"name":"pySpark","optional":true},{"name":"Python","optional":true},{"name":"Rest API","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-11-05T23:11:59Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-08T18:56:49Z","board_verified":true,"closed_at":null,"days_open":2,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":2},"description":"About Indicium AI\nIndicium AI is trusted by the world's leading enterprises to deliver AI into production at scale. We are a global, AI-native consultancy with deep expertise across Financial Services, Energy & Utilities, Healthcare & Life Sciences, Retail & CPG, and Manufacturing - guiding organizations from strategy through build to measurable business outcomes. With 600+ AI experts, 50+ enterprise clients, and five global locations, we work side-by-side with the world's leading AI partners - including Anthropic, Databricks, AWS, OpenAI, and Microsoft - to deliver modern AI with speed, clarity, and lasting impact.\nAs a global company, we offer career opportunities across Europe and the Americas and are looking for talent eager to grow globally with our team. Please indicate in your application if you are available to work abroad and if you hold a European passport.\nAbout the Opportunity\nThe Senior Data Engineer will act as the technical reference for data platforms on projects for industrial clients, modernizing lakehouses on Azure Databricks so they can support domain-based data products and AI use cases in operations. The role spans from diagnosing legacy platforms to designing the architecture for ingestion, environments, security, and cost control in production.\nThe position involves redesigning ingestion patterns with history preservation, separating development and production environments, protecting sensitive data in compliance with the LGPD (Brazilian General Data Protection Law), and reducing costs measurably. It also includes leading platform decisions within the squad, documenting them, and mentoring mid-level and junior data engineers, as well as preparing the handover to the support team.\nWe are looking for a hands-on professional who writes code, defends architecture decisions with data, and is driven to see stable, secure, and efficient platforms running in real-world operations.\nKey Responsibilities\nRedesigning ingestion with a raw/landing layer that preserves history, replacing full loads with overwrite by incremental and CDC patterns from SQL Server staging and source systems (ERP, HR, maintenance, SSMA, and operational systems).\nDefining the lakehouse architecture: medallion layers, separate DEV/HML/PRD environments, and a domain-based Unity Catalog strategy.\nImplementing data security and privacy by removing credentials from code (Key Vault, secret scopes, and service principals) and applying column masks, row filters, and ABAC in Unity Catalog to classified personal data, in compliance with the LGPD.\nOrchestrating pipelines with Lakeflow Jobs and Databricks Asset Bundles, using infrastructure as code (Terraform) and CI/CD on Azure DevOps, including linting, testing, and promotion across environments.\nEnsuring platform reliability through alerts with clear ownership and escalation, data refresh SLAs, data quality expectations, and observability using Databricks system tables.\nLeading platform FinOps (serverless vs. classic compute, cluster policies, budgets, and tags), with measurable cost reduction.\nTaking over and stabilizing legacy pipelines, leading incident handling, creating runbooks, and transferring knowledge to the support team.\nSupporting, when needed, the ingestion of industrial time series (process historian) for operational intelligence products.\nReviewing code, writing ADRs, and mentoring mid-level and junior data engineers.\nHaving the freedom and critical thinking to propose and challenge data engineering solutions.\nPreferred Qualifications & Experience\nSenior experience in production data engineering with Python, PySpark/Spark SQL, and Delta Lake.\nProduction experience with Databricks: Unity Catalog, Jobs/Lakeflow, Databricks Asset Bundles, and SQL Warehouse.\nExperience with Azure data services: ADLS Gen2, Key Vault, Entra ID, and networking fundamentals (Private Link, VNet).\nStrong command of ingestion patterns: CDC, incremental loads, Auto Loader, JDBC, REST APIs, and schema evolution.\nExperience with infrastructure as code (Terraform) and CI/CD for data platforms, including automated pipeline testing.\nHands-on experience with data security and privacy: personal data masking, access models, and LGPD.\nTrack record of reducing costs on cloud data platforms.\nExperience taking over and refactoring legacy data platforms.\nAbility to communicate technical and cost trade-offs to technical leadership and to defend architecture decisions against third-party recommendations.\nAutonomy to deliver at a fast pace in legacy environments, without a long learning curve on the stack.\nFluent Portuguese and intermediate/advanced English.\nAvailability for a hybrid model, 2 days a week in São Paulo.\nNice to haves\nSAP data integration (S/4HANA, SAP Datasphere / Business Data Cloud, Delta Sharing) and TOTVS Protheus.\nExperience with industrial data: AVEVA PI System / PI Web API, OPC UA, MQTT, Structured Streaming, or Azure Event Hubs.\nKnowledge of dbt.\nExperience migrating legacy BI (Qlik to Power BI).\nExperience with SOX / ITGC controls on data platforms.\nDatabricks Data Engineer Professional or Azure certification.\nExperience with heavy industry data.\nWhy Indicium AI\nWork on AI projects that actually transform the world's largest enterprises\n\nUse cutting-edge AI tools and technologies every single day\n\nCollaborate with global teams on high-impact, real-world solutions\n\nBe backed by a supportive team that's genuinely in your corner\n\nBenefit from serious investment in your learning and career growth\n\nEarn competitive compensation and benefits\n\nEnjoy company events and gatherings that bring the global team together\n\nJoin a fast-growing company where ambitious careers thrive\n\nSelection Process Stages\nInterview with Talent Acquisition\n\nTechnical Challenge\n\nInterview with Technical Management\n\nEvidence Storage\n\nAs part of our commitment to Information Security and in compliance with the requirements of the ISO 27001 standard (item 7.2, clause d), we would like to inform you that in future stages of the selection process, you will be required to provide proof of the skills and qualifications mentioned in your resume (such as diplomas and certificates). This verification is mandatory and essential to ensure compliance with our governance standards prior to hiring.\nSome of the benefits offered by Indicium:\nOur Culture\nModern, transparent, and inclusive management.\n\nDynamic environment, open to innovation and creativity.\n\nData-driven culture.\n\nAutonomy and engagement.\n\nLight and relaxed atmosphere with a focus on challenges.\n\nHigh-growth environment (Fast-paced scaling).\n\nRemote work and flexible hours.\n\nFor Your Professional Development\nStructured career path.\n\nFeedback and growth culture (45/90-day onboarding reviews and semi-annual performance cycles).\n\nMentorship Program for dedicated support during onboarding.\n\nExperienced and collaborative team.\n\nHigh-impact projects.\n\nAgile methodologies and cross-functional teams.\n\nFree weekly English conversation classes.\n\nCertification Program (full financial support and performance rewards).\n\nTutoring opportunities at Indicium Academy.\n\nInternal initiatives such as \"Tech Tracks\" and \"Databloggers.\"\n\nFor Your Health and Wellbeing\nGlobal offices in Florianópolis, São Paulo, New York, Lisbon, and London.\n\nIn-office snacks and beverages.\n\nPoints and rewards program.\n\nPsychological support via \"Programa Oxigênio\" and Zenklub.\n\nBirthday day off.\n\nWeekly happy hours and game nights (both remote and in-person).\n\nWellhub (formerly Gympass).\n\nBradesco Health Insurance.\n\nFlash Card (flexible benefits - total R$ 1,350.00).\n\nAnnual bonus (performance-based).\n\nReferral Program (R$ 250 per successful hire).\n\nExtended maternity leave (6 months).","description_format":"text","description_chars":7727,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"phd","optional":false},"security_clearance":true,"languages":[{"language":"Portuguese","level":"Advanced (C1)","optional":true},{"language":"English","level":"Advanced (C1)","optional":true}]},"benefits":["Company events","Health insurance","Professional development"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","AI Consulting & Integration","Data Engineering & Migration Services"],"lifecycle":[{"event":"open","at":"2026-11-06T02:55:02Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":2,"expected_fill_days":34,"reasons":["conf:3","velocity","win:early"],"computed_at":"2026-11-08T05:47:12Z"},"pay":null,"html_url":"https://alion.io/job/indicium-ai-senior-data-engineer-data-ai","json_url":"https://alion.io/job/indicium-ai-senior-data-engineer-data-ai.json","meta":{"generated_at":"2026-11-08T19:08:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":40017,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-09T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2826334},"rest":"https://alion.io/mcp/rest/get_company?id=2826334"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Findicium-ai-senior-data-engineer-data-ai"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":2,"usd":0.2},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Findicium-ai-senior-data-engineer-data-ai"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Findicium-ai-senior-data-engineer-data-ai"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/indicium-ai-senior-data-engineer-data-ai\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Findicium-ai-senior-data-engineer-data-ai"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3850467}},{"tool":"search_jobs","arguments":{"company":"indicium.ai","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3850467},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}