{"id":4422681,"url":"https://alion.io/job/valtech-senior-data-engineer-13","title":"Senior Data Engineer","company":{"id":8990,"name":"Valtech","domain":"valtech.com","url":"https://alion.io/company/valtech","size_band":"5000+","is_staffing_agency":false,"employer_type":"services","is_intermediary":false,"listed_via":null,"ats_vendor":"Greenhouse","truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Lisbon, Portugal"],"countries":["PT"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agile","optional":false},{"name":"Airflow","optional":false},{"name":"Amazon Kinesis","optional":false},{"name":"Amazon Redshift","optional":false},{"name":"Amazon S3","optional":false},{"name":"Apache Kafka","optional":false},{"name":"AWS","optional":false},{"name":"AWS Lambda","optional":false},{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"CloudFormation","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"GCP","optional":false},{"name":"Google BigQuery","optional":false},{"name":"LLM","optional":false},{"name":"MLFlow","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"Terraform","optional":false}],"status":"live","first_seen_at":"2026-11-16T00:00:00Z","employer_posted_date":null,"last_verified_at":"2026-11-16T00:00:00Z","board_verified":false,"closed_at":null,"days_open":1,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":1},"description":"Sobre a vaga\nWe are looking for an experienced Senior Data Engineer to design, build, and optimize modern, cloud-based data platforms that power analytics, AI, and data products. You will work on scalable batch, streaming, and near-real-time pipelines, delivering high-quality curated datasets with robust governance, security, and observability.\n\nO que vais fazer\n\nDesign and implement scalable data platforms and pipelines, primarily on AWS and Databricks, and on GCP or Azure/Fabric where projects require\nDevelop reliable batch, streaming, and near-real-time pipelines using Spark and Delta Lake\nBuild ingestion, transformation, and curation workflows for structured and unstructured data\nImplement lakehouse patterns and medallion layering (bronze, silver, gold), ensuring reusable, scalable systems aligned with enterprise needs\nContribute to cloud-to-cloud migrations, including re-platforming pipelines and data models\nDeliver model-ready, production-grade datasets for analytics, ML, causal modeling, and optimization\nBuild data pipelines for GenAI use cases (LLMs, RAG, vector-based data flows) and agent-based architectures\nLeverage Databricks MLflow and Unity Catalog, or equivalent tooling on other platforms\nDesign logical and physical data models for analytical and operational use cases\nOrchestrate workflows with Databricks Workflows, Airflow, dbt, or equivalents (e.g., Azure Data Factory, Cloud Composer), with a focus on automation, reliability, and maintainability\nApply event-driven and streaming architecture patterns\nEnsure data governance, lineage, quality, and access control (RBAC/ABAC) using Unity Catalog, AWS Lake Formation, or equivalents (Microsoft Purview, GCP Dataplex)\nEstablish observability: data freshness, pipeline reliability, and SLA adherence\nEnable serving layers (APIs, feature inputs, analytical endpoints) for downstream ML and AI platforms\nContinuously optimize pipelines and infrastructure for performance, scalability, and cost\nAsk the right questions to understand not just what stakeholders want, but why\nSurface gaps and better alternatives rather than executing a brief as written\nWork closely with data scientists, ML engineers, analysts, and business stakeholders\nSupport adoption of data products and contribute to best practices\n\nO que é pedido\n\nStrong hands-on experience with Apache Spark and Delta Lake\nStrong Python and SQL\nProven experience building batch and streaming pipelines and production-grade data platforms\nSolid understanding of data modeling, data quality, and governance\nStrong, demonstrable hands-on experience with the Databricks Lakehouse Platform, ideally on AWS (e.g., S3, Glue, EMR, Redshift, Kinesis, Lambda)\nDeep expertise in at least one major cloud (AWS, GCP, or Azure/Fabric), plus demonstrable openness and ability to work across clouds\nExperience with lakehouse architectures and distributed systems\nStrong understanding of scalability, reliability, and performance\nNaturally curious, with strong problem-solving skills and a collaborative approach in cross-functional teams\nComfortable challenging business requirements rather than taking them at face value\nAdaptable and eager to work across platforms\nCurrently living in Portugal and have the right to work in Portugal\n\nValorizado\n\nAgile or consulting experience is beneficial\nHands-on experience across more than one cloud, or cloud migration experience (e.g., Azure to GCP)\nSnowflake experience\nGenAI and AI data systems (RAG pipelines, vector databases, LLM data preparation)\nCI/CD for data pipelines and infrastructure-as-code (Terraform, CloudFormation)\nStreaming technologies (e.g., Kafka), Spark optimization, or ML/experimentation platforms\nExperience building data products or large-scale analytics platforms\nGCP experience (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc) is highly valued, especially in migration contexts\n\nO que é oferecido\n\nCompetitive compensation package\nFlexibility, with remote and hybrid work options (country-dependent)\nCareer advancement, with international mobility and professional development programs\nLearning and development, with access to cutting-edge tools, training and industry experts\n\nResumo organizado por IA a partir do anúncio original. Confirma os detalhes no site da empresa.","description_format":"text","description_chars":4280,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Hybrid work","Professional development"],"hiring_locations":[{"name":"Portugal","iso":"PT","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["E-commerce Platforms","CMS & Digital Experience Platforms","IT Consulting & Digital Transformation","Digital Marketing"],"lifecycle":[{"event":"open","at":"2026-11-17T00:48:45Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":1,"expected_fill_days":36,"reasons":["seen:1","velocity","win:early"],"computed_at":"2026-11-17T05:47:56Z"},"pay":null,"html_url":"https://alion.io/job/valtech-senior-data-engineer-13","json_url":"https://alion.io/job/valtech-senior-data-engineer-13.json","meta":{"generated_at":"2026-11-17T15:53:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":27916,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-18T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":8990},"rest":"https://alion.io/mcp/rest/get_company?id=8990"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fvaltech-senior-data-engineer-13"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fvaltech-senior-data-engineer-13"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fvaltech-senior-data-engineer-13"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/valtech-senior-data-engineer-13\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fvaltech-senior-data-engineer-13"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4422681}},{"tool":"search_jobs","arguments":{"company":"valtech.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4422681},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}