{"id":3725744,"url":"https://alion.io/job/alter-domus-senior-data-engineer","title":"Senior Data Engineer","company":{"id":54681,"name":"Alter Domus","domain":"alterdomus.com","url":"https://alion.io/company/alter-domus","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career sitemap","truth_index":{"grade":"B","score":83,"open_postings":24,"ghost_share":0,"stale_share":0.875,"repost_share":0,"time_to_fill_p50_days":19,"computed_at":"2026-11-07T05:47:08Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":7,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"Airflow","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"Model Context Protocol","optional":false},{"name":"pySpark","optional":false},{"name":"Self-Healing","optional":false},{"name":"Snowflake","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Amazon CloudWatch","optional":true},{"name":"Amazon S3","optional":true},{"name":"Apache Iceberg","optional":true},{"name":"AWS Lambda","optional":true},{"name":"Docker","optional":true},{"name":"GitHub Actions","optional":true},{"name":"IAM","optional":true},{"name":"Python","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-03T00:00:00Z","employer_posted_date":"2026-11-05","last_verified_at":"2026-11-07T08:54:31Z","board_verified":true,"closed_at":null,"days_open":4,"trust":{"level":"ok","repost_count":1,"flags":[],"days_open":4},"description":"ABOUT US:\nAs a world leading provider of integrated solutions for the alternative investment industry, Alter Domus (meaning “The Other House” in Latin) is proud to be home to 90% of the top 30 asset managers in the private markets, and more than 6,000 professionals across 24 jurisdictions.\nWith a deep understanding of what it takes to succeed in alternatives, we believe in being different in what we do, how we work, and most importantly in how we enable and develop our people. Invest yourself in the alternative, and join an organization where you progress on merit, where you can speak openly with whoever you are speaking to, and where you will be supported along whichever path you choose to take.\nFind out more about life at Alter Domus at careers.alterdomus.com\nJob Summary:\nJoin our team as a Senior Data Engineer building and operating the Alter Domus data platform, a Databricks lakehouse on AWS that hydrates data from our fund administration, accounting, and market data sources and delivers it to internal teams, client-facing products, and our AI engineering group. You will own pipelines end to end, from source ingestion through governed publication, and provide technical leadership and mentorship to engineers across our onshore and offshore teams in a regulated financial services environment.\nKey Responsibilities:\nLakehouse Pipeline EngineeringDesign, build, and operate end-to-end data pipelines on Databricks using Lakeflow jobs, Delta Lake, and Databricks Asset Bundles, deployed through CI/CD across development, simulation, and production environments.\nImplement pipelines against our medallion architecture, moving data from raw staging through cleansed and conformed layers to business-ready published tables, including quarantine handling for exception records.\nBuild ingestion from JDBC databases, file drops, SaaS APIs, and change data capture feeds, using Auto Loader and incremental load patterns.\nOperate and improve the existing Airflow (Amazon MWAA) and help migrate workloads onto Databricks-native orchestration.\nTune Spark and SQL workloads for performance and cost, including partitioning, file layout, table maintenance, and appropriate use of serverless versus classic compute.\n\nData Modeling and QualityDesign data models across the lakehouse and build modular, testable transformations in dbt, PySpark, and SQL that serve BI reporting, outbound client delivery, downstream APIs, and AI-assisted data access.\nBuild reconciliation and validation directly into pipelines: control count checks across layers, deduplication, idempotent reprocessing, and self-healing recovery paths.\nOwn production support for your pipelines, including monitoring, alerting, and root cause resolution against delivery SLAs, some of which are measured in minutes.\n\nGovernance and Client DeliveryImplement governance in Unity Catalog: catalog and schema design, tagging, lineage, and group-based grants synchronized from our identity provider.\nWork with the platform and security teams on fine-grained entitlements so that each client and internal team sees only the data it is permitted to see in a multi-tenant environment.\nDeliver data outbound to clients and downstream systems through Snowflake and Databricks secure views and shares, file exports, and APIs, and support the onboarding of new clients onto the platform.\n\nEnabling AI EngineeringModel and publish curated, well-documented datasets that our AI engineering team can consume reliably.\nBuild and maintain the Genie spaces that allow AI engineers and their agents to query platform data in natural language, including the semantic metadata and metric definitions that make results accurate.\nBuild and operate MCP (Model Context Protocol) services that expose governed platform data to AI agents and applications, with entitlements and audit logging enforced at the access layer.\n\nTechnical LeadershipProvide technical leadership and mentorship to engineers, including distributed and offshore delivery teams, through design review, code review, and pairing.\nDrive and document architectural decisions, set standards for pipeline development and testing, and contribute to the platform roadmap.\nCommunicate technical solutions clearly to non-technical stakeholders and senior leadership and translate business requirements into scalable technical designs.\n\nQualifications & Skills:\nEducation & Experience7+ years of experience in data engineering, including substantial time running a cloud data platform in production.\nDemonstrated technical leadership: mentoring engineers, leading design, and owning delivery of complex projects.\nBachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.\n\nTechnical SkillsDatabricks: strong hands-on experience with PySpark, Delta Lake, job orchestration, and Spark performance tuning at scale, plus Unity Catalog governance, Asset Bundles or equivalent declarative deployment, and Auto Loader. Exposure to Genie spaces, Databricks Apps, or Lakebase is a plus.\nAdvanced proficiency with dbt or a comparable SQL transformation framework, including testing and modular design, with strong dimensional and semi-structured data modeling skills.\nExpert-level Python and SQL, with solid software engineering fundamentals in testing, documentation, and code quality.\nAWS: S3, IAM, Secrets Manager, Lambda, Glue, and CloudWatch, with infrastructure as code in Terraform. Working knowledge of Athena and Apache Iceberg is valuable, as part of our estate still runs on them.\nAirflow, ideally Amazon MWAA, including DAG design, dependency management, retries, and alerting.\nExperience delivering data to consumers through warehouse shares, file exports, or APIs. Snowflake (secure views, shares, schemachange) is a plus, as is an understanding of how AI agents consume structured data through MCP or similar tool-based access patterns.\nCI/CD for data pipelines using GitHub Actions or equivalent, containerization with Docker, and environment-promoted, version-controlled deployments.\n\nSoft SkillsStrong problem-solving and analytical ability, with a track record of resolving complex production issues.\nClear written and verbal communication, with the ability to influence stakeholders and explain trade-offs.\nComfortable in a fast-moving environment with shifting priorities and multiple concurrent client commitments.\n\nPreferred Certifications & Experience:\nDatabricks certifications (Data Engineer Associate or Professional) are a strong plus.\nAWS certifications (Solutions Architect, Data Engineer) are a plus.\nExperience supporting AI or analytics engineering teams as a data provider.\nExperience in financial services, particularly private equity, private credit, real estate, or fund administration, is not required but will be highly impactful in this role.\nWHAT WE OFFER:\nWe are committed to supporting your development, advancing your career, and providing benefits that matter to you.\nOur industry-leading Alter Domus Academy offers six learning zones for every stage of your career, with resources tailored to your ambitions and resources from LinkedIn Learning.\nOur global benefits also include:\nSupport for professional accreditations \nFlexible arrangements, generous holidays, plus an additional day off for your birthday!\nContinuous mentoring along your career progression \nActive sports, events and social committees across our offices \n24/7 support available from our Employee Assistance Program \nThe opportunity to invest in our growth and success through our Employee Share Plan \nPlus additional local benefits depending on your location \nAlter Domus is an Equal Opportunity Employer: Equity Statement\nAll qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, or protected veteran status.\n(Alter Domus Privacy notice can be reviewed via Alter Domus webpage: https://alterdomus.com/privacy-notice/)","description_format":"text","description_chars":7976,"description_truncated":false,"requirements":{"experience_years_min":7,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Equity"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Financial Advisory, Valuation & Restructuring","Custody & Fund Administration"],"lifecycle":[{"event":"open","at":"2026-11-04T05:14:08Z"},{"event":"close","at":"2026-11-05T05:18:12Z"},{"event":"reopen","at":"2026-11-06T06:23:16Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 4 · green card filings: 2","filings_12m":4,"filings_prev_12m":1,"green_card_filings_12m":2,"median_offered_wage_usd":140833,"route":null,"cap_exempt":false,"checked_at":"2026-11-07T07:57:00+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":0}],"liveness":{"score":63,"band":"ok","label":"Likely open","p_open":1,"p_active":0.632,"p_room":1,"age_days":4,"expected_fill_days":19,"reasons":["conf:0","stale_co","velocity","win:early","comp:brand"],"computed_at":"2026-11-07T05:47:08Z"},"pay":null,"html_url":"https://alion.io/job/alter-domus-senior-data-engineer","json_url":"https://alion.io/job/alter-domus-senior-data-engineer.json","meta":{"generated_at":"2026-11-07T09:52:07Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":8221,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":54681},"rest":"https://alion.io/mcp/rest/get_company?id=54681"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Falter-domus-senior-data-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Falter-domus-senior-data-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Falter-domus-senior-data-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/alter-domus-senior-data-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Falter-domus-senior-data-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3725744}},{"tool":"search_jobs","arguments":{"company":"alterdomus.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3725744},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}