{"id":2931639,"url":"https://alion.io/job/epsilon-senior-databricks-engineer","title":"Senior Databricks Engineer","company":{"id":410,"name":"Epsilon","domain":"epsilon.com","url":"https://alion.io/company/epsilon","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":21000,"max_usd":46000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":75},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"GCP","optional":false},{"name":"Git","optional":false},{"name":"Incident Management","optional":false},{"name":"Platform Engineering","optional":false},{"name":"PostgreSQL","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Apache Kafka","optional":true},{"name":"Grafana","optional":true},{"name":"MLFlow","optional":true},{"name":"Prometheus","optional":true}],"status":"live","first_seen_at":"2026-10-20T14:35:45Z","employer_posted_date":null,"last_verified_at":"2026-10-20T14:35:45Z","board_verified":false,"closed_at":null,"days_open":7,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":7},"description":"We are seeking an experienced Senior Databricks Engineer to design, implement, automate, and support enterprise-scale Databricks platforms across AWS, Azure, and GCP. The role will focus on Databricks workspace management, Lakehouse architecture, cloud migrations, platform automation, governance, security, cost optimisation, and operational excellence. The candidate will work closely with Data Engineering, Decision Science, Product Engineering, Cloud Infrastructure, and Security teams to deliver scalable and secure data platforms.\n\nResponsibilities: \nDatabricks Platform Engineering: Own the design, deployment, administration, and lifecycle management of enterprise Databricks workspaces across AWS, Azure, and GCP.\nCloud and Infrastructure Integration: Enable secure connectivity, authentication, networking, and integration between Databricks and enterprise cloud platforms and databases.\nMigration and Modernisation: Lead migration of legacy data platforms, analytics workloads, and databases to the Databricks Lakehouse architecture.\nAutomation and DevOps: Drive Infrastructure-as-Code, CI/CD, and operational automation to improve platform scalability, consistency, and efficiency.\nSecurity and Governance: Implement enterprise-grade security, access controls, compliance, auditing, and data governance using Unity Catalogue and identity integrations.\nPerformance and Cost Optimisation: Continuously optimise Databricks workloads, storage layouts, and compute resources to improve performance and reduce cloud spend.\nMonitoring and Operational Support: Establish proactive monitoring, incident management, troubleshooting, and platform reliability practices for business-critical workloads.\nAI and Innovation: Evaluate and implement Databricks AI, GenAI, and automation capabilities to enhance platform operations and business value.\nStakeholder: Partner with architects, engineering teams, security teams, and business partners while mentoring engineers and driving platform standards.\n\nRequirements: \n3+ years of overall experience in Databricks.\nSolid experience with Databricks administration and platform engineering.\nExpertise in Spark, PySpark, SQL, Delta Lake, Unity Catalogue, and Workflows.\nExperience with AWS, Azure, and/or GCP.\nStrong Python scripting and automation experience.\nExperience with Terraform and Infrastructure as Code.\nHands-on experience with CI/CD pipelines and Git-based deployments.\nGood understanding of networking, private link connectivity, SSO, SAML/OIDC, and security concepts.\nExperience with PostgreSQL, SQL Server, Oracle, or cloud-native databases.\nKnowledge of data governance, metadata management, and compliance controls.\n\nPreferred Skills: \nDatabricks Certified Professional Data Engineer and Cloud certifications (AWS/Azure/GCP)\nExperience with Lakehouse migrations.\nKnowledge of Kafka, ELK, Prometheus, Grafana, and cloud observability tools.\nExperience with MLflow, Databricks Genie, and GenAI solutions.\nExperience supporting large-scale enterprise analytics platforms.\nExposure to multi-cloud environments and global data platforms.\nB. S. /B. E. in a related field or equivalent work experience required.\nDatabrick/AWS certification is a plus.\nSkills\napache spark, databricks, infrastructure as code, pyspark, spark, terraform","description_format":"text","description_chars":3287,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Marketing Automation","Email Marketing"],"lifecycle":[{"event":"open","at":"2026-10-20T14:35:45Z"}],"visa":[{"country":"US","licensed_sponsor":true,"evidence":"Filed H-1B visas in the last two years","filings_12m":0,"filings_prev_12m":1,"green_card_filings_12m":0,"median_offered_wage_usd":null,"route":null,"cap_exempt":false,"checked_at":"2026-10-15T11:24:14+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)"],"filings_for_role_12m":0}],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":6,"expected_fill_days":26,"reasons":["seen:6","velocity","win:early"],"computed_at":"2026-10-27T05:46:45Z"},"pay":null,"html_url":"https://alion.io/job/epsilon-senior-databricks-engineer","json_url":"https://alion.io/job/epsilon-senior-databricks-engineer.json","meta":{"generated_at":"2026-10-27T21:33:31Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":13019,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-28T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":410},"rest":"https://alion.io/mcp/rest/get_company?id=410"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fepsilon-senior-databricks-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fepsilon-senior-databricks-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fepsilon-senior-databricks-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/epsilon-senior-databricks-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fepsilon-senior-databricks-engineer"}]}