{"id":3466222,"url":"https://alion.io/job/bennett-data-science-senior-data-engineer-databricks","title":"Senior Data Engineer, Databricks","company":{"id":4486771,"name":"Bennett Data Science","domain":"bennettdatascience.com","url":"https://alion.io/company/bennett-data-science","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"board_field","remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Ukraine"],"countries":["UA"],"hiring_countries":["UA"],"hiring_countries_total":1,"salary":null,"salary_estimate":{"min_usd":23000,"max_usd":61000,"period":"year","method":"global_role_cell_scaled_by_country","sample_n":2679},"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Machine Learning","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"dbt","optional":true}],"status":"live","first_seen_at":"2026-10-14T23:04:04Z","employer_posted_date":null,"last_verified_at":"2026-10-14T23:04:04Z","board_verified":false,"closed_at":null,"days_open":22,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":22},"description":"We are looking for a senior data engineer with deep Databricks experience to own the data platform behind one of our largest enterprise accounts and lead its migration from AWS to Databricks.\n\nAbout the role\n\nData infrastructure is the foundation of everything we deliver. Our models, dashboards, and the decisions our clients make on top of them are only as reliable as the pipelines underneath, which is why we put the platform first.\n\nYou will join a small senior team working inside the client's environment. Through the rest of 2026 you will take ownership of the existing pipelines and the architecture around them. From 2027 you will lead the migration to Databricks: designing the target architecture, planning the cutover, and doing the implementation. This is a hands-on engineering role with real architectural authority. You decide how the platform gets built, and then you build it.\n\nYou will be the person the team turns to on anything Databricks, working alongside senior machine learning engineers and data scientists who depend on what you deliver.\n\nWhat you will do:\n\nDesign and build the target Databricks architecture, and plan the migration from the current AWS stack\n\nBuild and maintain production data pipelines: ingestion, transformation, and orchestration\n\nOwn data quality, including the checks and alerts that catch problems before the client does\n\nDesign the data models the analytics and machine learning work sits on\n\nSupport the pipelines you build: monitoring, alerting, and the on-call reality of production data\n\nWork directly with the client's engineers, and explain technical decisions to people who are not engineers\n\nRequirements:\n\nFive or more years in data engineering or software development\n\nAt least three years of production Databricks work\n\nDeep experience with Spark, Delta Lake, and Unity Catalog\n\nHas planned and executed at least one migration onto Databricks from another platform, and can walk through the challenges\n\nExpert Python: clean modular code, comfortable with optimization and profiling\n\nAdvanced SQL and relational database work: raw SQL, data modeling, scripted migrations\n\nSystems design: how storage and compute fit together, end to end pipelines, containerized applications\n\nCloud operations on AWS or equivalent: networking, identity and access management, monitoring and alerting, and the domain knowledge for why things break\n\nComfortable working inside a client's environment, with their data and their constraints\n\nStrong written English, and spoken English good enough to present your work\n\nAvailable for some overlap with United States working hours\n\nNice to have:\n\nDatabricks certification\n\nDeep AWS experience specifically, since that is the platform we are migrating from\n\ndbt, Airflow, or a similar transformation and orchestration framework\n\nMachine learning pipeline experience, since models run on top of what you build\n\nBackground in utilities, energy, telecoms, or another regulated industry\n\nExperience being the senior engineer a client relies on directly\n\nYou are:\n\nCareful with data quality, and you ask when something looks wrong instead of guessing\n\nA self starter who can turn a general requirement into a specific estimate and a deliverable\n\nSomeone who documents. We write things down, and every number we deliver carries its source\n\nComfortable in a small remote team where nobody is checking your hours\n\nAbout Bennett Data Science\n\nWe have spent ten years building predictive analytics and data science for enterprise clients, from some of the largest companies in the world to startups in Silicon Valley. Our engineers sit inside the client's systems and build critical systems. The work ships to production and lands at the bottom line.\n\nWhat we offer:\n\nCompetitive compensation, reviewed as you grow\n\nWork from anywhere, with a flexible schedule\n\nA small senior team, so your work is visible and your decisions are important\n\nDirect exposure to enterprise clients and the problems they actually have\n\nMentorship from senior staff, and the space to grow and mentor others","description_format":"text","description_chars":4066,"description_truncated":false,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":["Flexible schedule"],"hiring_locations":[{"name":"Ukraine","iso":"UA","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":[],"lifecycle":[{"event":"open","at":"2026-10-29T15:24:45Z"}],"visa":[],"liveness":{"score":50,"band":"ok","label":"Likely open","p_open":0.85,"p_active":0.782,"p_room":0.75,"age_days":21,"expected_fill_days":29,"reasons":["seen:21","win:late"],"computed_at":"2026-11-05T05:54:30Z"},"pay":null,"html_url":"https://alion.io/job/bennett-data-science-senior-data-engineer-databricks","json_url":"https://alion.io/job/bennett-data-science-senior-data-engineer-databricks.json","meta":{"generated_at":"2026-11-06T01:43:27Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2867,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-07T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4486771},"rest":"https://alion.io/mcp/rest/get_company?id=4486771"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbennett-data-science-senior-data-engineer-databricks"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbennett-data-science-senior-data-engineer-databricks"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbennett-data-science-senior-data-engineer-databricks"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bennett-data-science-senior-data-engineer-databricks\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbennett-data-science-senior-data-engineer-databricks"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3466222}},{"tool":"search_jobs","arguments":{"company":"bennettdatascience.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3466222},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}