{"id":475662,"url":"https://alion.io/job/causeway-senior-data-engineer","title":"Senior Data Engineer","company":{"id":183715,"name":"Causeway","domain":"causeway.com","url":"https://alion.io/company/causeway","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Teamtailor","truth_index":{"grade":"A","score":95,"open_postings":3,"ghost_share":0,"stale_share":0,"repost_share":0,"time_to_fill_p50_days":106,"computed_at":"2026-10-26T05:57:25Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"explicit","locations":["Lisbon, Portugal"],"countries":["PT"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":37000,"max_usd":77000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":11},"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Amazon S3","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Digital Twin","optional":false},{"name":"GCP","optional":false},{"name":"IAM","optional":false},{"name":"pgvector","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Semantic Search","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Agile","optional":true},{"name":"Knowledge Graph","optional":true},{"name":"Machine Learning","optional":true}],"status":"live","first_seen_at":"2026-06-30T08:37:17Z","employer_posted_date":"2026-06-30","last_verified_at":"2026-10-12T04:25:25Z","board_verified":false,"closed_at":null,"days_open":117,"trust":{"level":"ok","repost_count":0,"flags":[],"days_open":117},"description":"Senior Data Engineer\nLisbon - Hybrid\nDo you want to help shape software that affects thousands of lives?\nWho are we?\nWe are ranked as the UK’s #1 construction specific software player and our mission is simple; to provide market leading end-to-end software solutions to the construction and construction like industries across the entire build life cycle.\nIf you are looking to build an exceptional career with an award-winning company you’ve come to the right place. Our teams are based in the UK, Europe, and India, working on products that are used on a global scale. We have a clear and defined road map to deliver over the next 3 years, which is centred around a large-scale digital transformation as well as continuing our growth and expansion.\nWe embrace diversity and equality and want our employees to be comfortable bringing their whole selves to work. We are committed to building a team with a variety of backgrounds, skills and views. Creating a culture of Equality isn’t just the right thing to do, it improves every aspect of our business.\nPurpose\nThe Senior Data Engineer plays a central role in building Causeway’s next-generation data platform on Databricks, a platform that unifies data from across the Causeway product estate and a wide range of third-party sources into a typed, entity-resolved digital twin that AI agents can reason over.\nThe Senior Data Engineer owns significant slices of the medallion pipeline (bronze to silver to gold), the modelling layer that turns raw Delta tables into typed object and relationship tables, and the serving layer that makes the graph queryable by agents with interactive latency. The role is expected to design for scale, set the bar for engineering quality across the team, and make architectural decisions that are durable.\nThe key areas of responsibility for the Senior Data Engineer include:\nMedallion Pipeline & Graph Engineering,\nData Quality & Governance,\nTechnical Leadership & Collaboration.\nKey Responsibilities\nMedallion Pipeline & Graph Engineering\nDesign and own ingestion into the bronze layer from a variety of sources, selecting the appropriate pattern per source. Including Auto Loader, API pull, event-driven, database replica/CDC, and CQRS read models and agreeing data contracts with Architects and Product teams.\nBuild and maintain the silver and gold medallion layers as Delta Live Tables and PySpark notebooks, handling deduplication, entity resolution (deterministic and probabilistic), canonical ID assignment, and projection into typed object and relationship tables.\nGenerate and maintain the typed relationship graph that transforms disconnected gold tables into a traversable digital twin.\nOwn and evolve the serving layer that makes the graph queryable by AI agents at interactive latency.\nContribute to the design and evolution of the broader Causeway data platform architecture, ensuring solutions are scalable, maintainable, and aligned with cloud-native best practices.\nData Quality & Governance\nOwn the data quality and testing story end-to-end, implementing automated frameworks that validate completeness, accuracy, consistency, and schema conformance across pipeline stages.\nDeliver governance via Unity Catalog, covering multi-tenant isolation, row-level security, lineage, audit logging, and the tenant-scoped extension schema that supports custom objects from external customer systems.\nEnsure data assets are catalogued correctly with appropriate metadata, security classifications, and sensitivity labels in line with company data governance standards.\nMonitor pipeline health and data quality metrics, proactively identifying and resolving issues before they affect downstream consumers or agent behaviour.\nTechnical Leadership & Collaboration\nMentor engineers across the data team, lead architectural discussions, conduct PR reviews, and challenge poor patterns, including those already in production.\nPartner with the Platform and Agent teams on the tool layer that exposes the graph to AI agents, ensuring datasets are agent-legible through rich column comments, typed relationships, embedding templates, and governed tooling.\nWork with Data Engineers to translate complex analytical requirements into structured, reusable datasets and features.\nContribute to the continuous improvement of data engineering practices, tooling, and standards across the team.\nTake responsibility for personal development, staying current with emerging technologies in data engineering, lakehouse architecture, and AI agent tooling.\nKey Skills, Experience and Qualifications\nEssential\nStrong production experience on Databricks, including Delta Lake, Delta Live Tables, Auto Loader, Unity Catalog, Databricks Asset Bundles, serverless and job compute, and Structured Streaming for near-real-time workloads.\nDeep proficiency in Python and PySpark for large-scale data processing and transformation.\nAdvanced SQL, including recursive CTEs for graph traversal, window functions, query planning, and the ability to interpret EXPLAIN output and optimise index usage.\nStrong experience with lakehouse architectures and data modelling for graph workloads - typed entities, edge tables, dimensional vs event-style modelling, and entity resolution across systems that do not share keys.\nHands-on experience with PostgreSQL as a serving layer, including pgvector for semantic search, pg_trgm for fuzzy matching, HNSW vs IVFFlat trade-offs, index tuning, and managing interactive-latency queries under concurrency.\nExpertise in data transformation, validation, and contract design.\nExperience building data test and observability frameworks.\nWorking knowledge of cloud storage and identity across AWS, Azure, and GCP - including S3, ADLS Gen2, GCS, cross-cloud copy, IAM roles, and storage credentials.\nGenuine curiosity about AI agents and how they consume data, with an understanding of what makes a dataset agent-legible.\nDesirable\nExperience with probabilistic entity resolution techniques and tools.\nFamiliarity with knowledge graph concepts and graph query languages.\nExposure to AI/ML workflows and feature engineering for machine learning models.\nWhat you get from us:\nIf you're looking to build an exceptional career with an award-winning company you’ve come to the right place. We believe everyone at Causeway has a vital role to play in our success. Causeway is fuelled by curiosity and is a place for people who beam with positivity and burn with ambition.\nOur team is everything, so we’ll take good care of you. In fact, we give well-being the same priority as our other business goals. We’re strong advocates of work-life balance, offering hybrid working alongside the opportunity to work from modern, collaborative offices.\nOur Values\nWe areUnited. As part of a team, we’re better together.\nWe areAgile. Be the change, we’re on a journey.\nWe areTrusted. Do the right thing, we own this.\nWe are Driven. Get stuck in, we make it happen.\nLike all responsible companies Causeway is aware of the need to recognise the importance of protecting our environment and addressing the climate emergency. Causeway is a carbon neutral company and we offset our calculated carbon footprint. However, we recognise that offsetting is not a permanent solution, so we set environmental objectives to reduce our footprint year-on-year.","description_format":"text","description_chars":7311,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Hybrid work"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"},{"name":"Germany","iso":"DE","kind":"region"},{"name":"France","iso":"FR","kind":"region"},{"name":"United Kingdom","iso":"GB","kind":"country"},{"name":"Austria","iso":"AT","kind":"region"},{"name":"Belgium","iso":"BE","kind":"region"},{"name":"Bulgaria","iso":"BG","kind":"region"},{"name":"Croatia","iso":"HR","kind":"region"},{"name":"Czech Republic","iso":"CZ","kind":"region"},{"name":"Denmark","iso":"DK","kind":"region"},{"name":"Finland","iso":"FI","kind":"region"},{"name":"Hungary","iso":"HU","kind":"region"},{"name":"Ireland","iso":"IE","kind":"region"},{"name":"Italy","iso":"IT","kind":"region"},{"name":"Netherlands","iso":"NL","kind":"region"},{"name":"Norway","iso":"NO","kind":"region"},{"name":"Poland","iso":"PL","kind":"region"},{"name":"Romania","iso":"RO","kind":"region"},{"name":"Spain","iso":"ES","kind":"region"},{"name":"Sweden","iso":"SE","kind":"region"},{"name":"Switzerland","iso":"CH","kind":"region"},{"name":"Estonia","iso":"EE","kind":"region"},{"name":"Greece","iso":"GR","kind":"region"},{"name":"Iceland","iso":"IS","kind":"region"},{"name":"Latvia","iso":"LV","kind":"region"},{"name":"Liechtenstein","iso":"LI","kind":"region"},{"name":"Lithuania","iso":"LT","kind":"region"},{"name":"Luxembourg","iso":"LU","kind":"region"},{"name":"Malta","iso":"MT","kind":"region"},{"name":"Portugal","iso":"PT","kind":"region"},{"name":"Slovakia","iso":"SK","kind":"region"},{"name":"Slovenia","iso":"SI","kind":"region"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Construction Management Software","Field Service Management Software"],"lifecycle":[{"event":"open","at":"2026-09-06T14:32:44Z"}],"visa":[],"liveness":{"score":14,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.785,"p_room":0.44,"age_days":117,"expected_fill_days":106,"reasons":["conf:337","win:tail","crowd:"],"computed_at":"2026-10-26T05:57:25Z"},"pay":null,"html_url":"https://alion.io/job/causeway-senior-data-engineer","json_url":"https://alion.io/job/causeway-senior-data-engineer.json","meta":{"generated_at":"2026-10-26T06:03:30Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8130,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-27T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":183715},"rest":"https://alion.io/mcp/rest/get_company?id=183715"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcauseway-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcauseway-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcauseway-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/causeway-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcauseway-senior-data-engineer"}]}