{"id":186468,"url":"https://alion.io/job/palo-it-data-engineer-2","title":"AI Native Data Engineer","company":{"id":5005,"name":"Palo IT","domain":"palo-it.com","url":"https://alion.io/company/palo-it","size_band":"501-1000","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Ashby","truth_index":{"grade":"A","score":90,"open_postings":30,"ghost_share":0,"stale_share":0.2,"repost_share":0,"time_to_fill_p50_days":68,"computed_at":"2026-10-21T05:46:15Z"}},"role":"Data Science","role_family":"Data Science","seniority":null,"employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["São Paulo, Brazil"],"countries":["BR"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Airflow","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Dagster","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"GCP","optional":false},{"name":"GDPR","optional":false},{"name":"Google BigQuery","optional":false},{"name":"Great Expectations","optional":false},{"name":"Looker","optional":false},{"name":"Machine Learning","optional":false},{"name":"Power BI","optional":false},{"name":"Python","optional":false},{"name":"Snowflake","optional":false},{"name":"SOC 2","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Tableau","optional":false},{"name":"Amazon Kinesis","optional":true},{"name":"Amazon SageMaker","optional":true},{"name":"MLFlow","optional":true},{"name":"Vertex AI","optional":true}],"status":"live","first_seen_at":"2026-08-31T20:35:33Z","employer_posted_date":"2026-08-31","last_verified_at":"2026-10-21T11:28:36Z","board_verified":true,"closed_at":null,"days_open":50,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":50},"description":"Who We Are \nBuilding the AI-first frontier enterprise.\nWe are a global technology consultancy with a trademarked, AI-first approach-Gen-e2™. It redefines how enterprises build digital products and transform their organizations with AI. We do the right thing, and we do it right. We're proud to be a World Economic Forum New Champion, and a B Corp-certified company.\nWe are small enough to care locally, big enough to deliver globally (10 countries, 450+ experts from 50+ nationalities)\n\nWe are becoming an agentic organization, adopting the AI-native operating model we bring to our clients.\n\nWe are robust and resilient (100% independent, 0 debt, founded 2009)\n\nWe are AI-native professionals who invest in what we believe and work as a collective intelligence\n\nWe are positive, courageous and deliver at the leading edge.\nYour Role\nAs a Data Engineer for a leading insurance company, you will play a key role in building a data-driven decision-making culture. You will design resilient and secure solutions that transform raw data into strategic insights for underwriting, risk management, fraud prevention, and customer experience.\nDesign, build, and maintain scalable and secure data pipelines in cloud environments (AWS, GCP, or Azure).\n\nIntegrate large volumes of structured and unstructured data from core insurance systems (such as policies, claims, CRM, ERP).\n\nAutomate data ingestion, transformation, and quality processes using tools such as Apache Spark, dbt, Kafka, and Airflow.\n\nBuild and maintain modern data lakes and warehouses (Snowflake, BigQuery, Redshift).\n\nImplement data quality, lineage, and governance validations (Great Expectations, Deequ, OpenMetadata).\n\nEnsure compliance with data regulations (GDPR, SOC2, etc.) and internal security policies.\n\nDesign optimized datasets to enable machine learning models, predictive analytics, and dashboards (Power BI, Looker, Tableau).\n\nCollaborate with data scientists, architects, and business stakeholders to democratize access to trusted data.\n\nDocument data architectures, pipelines, transformation standards, and lineage.\n\nWho You Are.\nExperience with modern data processing frameworks: Spark, databricks, dbt, Kafka, Apache Beam.\n\nStrong command of Python and advanced SQL.\n\nHands-on experience with Azure cloud platforms (Data Factory, Synapse).\n\nKnowledge of modern Data Lake / Data Warehouse design (Snowflake, Redshift, BigQuery).\n\nFamiliarity with DataOps, testing, and CI/CD practices in data pipelines.\n\nExperience with workflow orchestration systems such as Airflow or Dagster.\n\nUnderstanding of data quality and governance frameworks: Great Expectations, Deequ, DataHub, OpenLineage.\n\nUpper-intermediate English level (B2 or higher) for global collaboration.\n\nNice to Have\nKnowledge of streaming technologies: Kafka, Pub/Sub, Kinesis.\n\nFamiliarity with event-driven architectures and microservices.\n\nPrevious experience in the financial or insurance sector.\n\nCertifications such as Azure Data Engineer or Fabric Data Engineer.\n\nExperience with MLOps solutions (Vertex AI, SageMaker, MLFlow).\n\nMore About PALO IT \nOur clients include some of the world’s most successful companies. We collaborate with leading enterprises, next-generation businesses and frontier partners, shaping what comes next, helping them scale AI and solve complex business and technology challenges.\nWhat We Offer\nStimulating working environments\n\nUnique career path\n\nInternational mobility\n\nInternal R&D projects (including Gen-e2™)\n\nKnowledge sharing\n\nPersonalized training via PALO IT Academy\n\nEntrepreneurship & intrapreneurship\n\nFor more on our team culture and benefits, check out our careers page.","description_format":"text","description_chars":3658,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[{"language":"English","level":"Upper-Intermediate (B2)","optional":false}]},"benefits":[],"hiring_locations":[{"name":"Brazil","iso":"BR","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation","Custom Software Development"],"lifecycle":[{"event":"open","at":"2026-09-01T18:17:16Z"}],"visa":[],"liveness":{"score":58,"band":"ok","label":"Likely open","p_open":1,"p_active":0.778,"p_room":0.75,"age_days":50,"expected_fill_days":68,"reasons":["conf:3","velocity","win:late"],"computed_at":"2026-10-21T05:46:15Z"},"pay":null,"html_url":"https://alion.io/job/palo-it-data-engineer-2","json_url":"https://alion.io/job/palo-it-data-engineer-2.json","meta":{"generated_at":"2026-10-21T14:55:49Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":21269,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-22T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":5005},"rest":"https://alion.io/mcp/rest/get_company?id=5005"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpalo-it-data-engineer-2"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpalo-it-data-engineer-2"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpalo-it-data-engineer-2"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/palo-it-data-engineer-2\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpalo-it-data-engineer-2"}]}