{"id":2802672,"url":"https://alion.io/job/absi-usa-databricks-architectengineer","title":"Databricks Architect/Engineer","company":{"id":3800495,"name":"Absi Usa","domain":"absi-usa.com","url":"https://alion.io/company/absi-usa","size_band":"1-10","is_staffing_agency":false,"employer_type":"staffing","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"staff","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":31000,"max_usd":57000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":17},"experience_years_min":6,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Databricks","optional":false},{"name":"dbt","optional":false},{"name":"Delta Lake","optional":false},{"name":"pySpark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-08-01T05:41:44Z","employer_posted_date":null,"last_verified_at":"2026-08-01T05:41:44Z","board_verified":false,"closed_at":null,"days_open":83,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":83},"description":"Job Description :\n\nRoles & Responsibilities :\n\n1. Solutioning & Architecture :\n\n- Translate client requirements into Databricks-based solution designs - data pipelines, Lakehouse layouts, and serving layers.\n\n- Recommend the right Databricks components (Delta Live Tables, Workflows, Unity Catalog, Databricks SQL, Genie) for a given use case, based on data volume, latency, and governance needs.\n\n- Participate in pre-sales and proposal discussions, contributing effort estimates and technical approach for Databricks-based engagements.\n\n- Review architecture decisions with senior architects and flag risks or better alternatives early.\n\n2. Hands-On Build & Delivery :\n\n- Build and maintain end-to-end pipelines : ingestion (Auto Loader, DLT), transformation (dbt or native PySpark/SQL), and serving (Unity Catalog, Databricks SQL).\n\n- Work directly with pharma commercial datasets - IQVIA, Symphony, CRM, Hub/SP, claims - modeling them into clean, governed Delta Lake structures.\n\n- Develop and maintain reusable components: notebooks, job templates, SQL libraries, and data quality checks.\n\n- Configure and tune Genie Spaces and AI/BI dashboards for client-facing analytics use cases.\n\n- Own workspace-level hygiene : cluster policies, job scheduling, cost tracking, and basic performance tuning.\n\n3. Platform Currency & Best Practices :\n\n- Stay closely tracked with new Databricks releases and features (e.g. Lakehouse/RT, Genie enhancements, Metric Views) and assess their relevance to pharma use cases.\n\n- Bring new capabilities into existing client engagements where they create real value, not just for novelty.\n\n- Contribute to and maintain DataZymes' internal Databricks standards, templates, and knowledge base.\n\n- Support the certification and upskilling of junior engineers and analysts on the team.\n\n4. Client & Team Collaboration :\n\n- Act as the day-to-day Databricks technical point of contact on assigned client engagements.\n\n- Explain technical trade-offs in plain terms to non-technical stakeholders when needed.\n\n- Collaborate with analytics, forecasting, and delivery teams to make sure the platform serves the actual business question, not just the data movement.\n\n5. Practice Building :\n\n- Help establish the Databricks practice at DataZymes - codifying reusable design patterns, reference architectures, and coding standards as the team's project count grows.\n\n- Design and build solution accelerators for common pharma use cases (prescription analytics, patient cohort analysis, omnichannel attribution) that can be reused and adapted across clients.\n\n- Maintain the internal Databricks knowledge base - templates, checklists, and lessons learned from delivery.\n\n- Support partnership conversations with Databricks by contributing technical input - solution briefs, architecture references, and demo material - that the practice lead and account teams can take into partner and client discussions.\n\n- Help identify gaps in team capability and contribute to certification and enablement plans for engineers joining the practice.\n\nIdeal Candidate :\n\n- Strong hands-on Databricks Architect/Databricks Engineer Profile with end-to-end build-and-solution capability and Databricks professional certification.\n\nMandatory Experience :\n\n- Must have 6+ years in Data engineering/Data architect roles, with at least recent 3 years of hands-on Databricks experience.\n\n- Must be able to design a solution end-to-end and then build it themselves.\n\n- Must have experience translating client/business requirements into Databricks solution designs - data pipelines, Lakehouse layouts, and serving layers.\n\n- Must have built and maintained end-to-end pipelines - ingestion (Auto Loader, DLT), transformation (PySpark/SQL or dbt), and serving (Unity Catalog, Databricks SQL).\n\n- Mandatory (Certification) : Must hold at least one active Databricks Professional-level certification (Data Engineer Professional preferred), OR deep hands-on project experience with an Associate certification in hand.\n\nMandatory Tech skill :\n\n- Must have solid working knowledge across the Databricks stack - Delta Lake, Delta Live Tables, Unity Catalog, Auto Loader, Databricks SQL, Workflows, and cluster/job configuration.\n\n- Must have strong SQL and PySpark skills, able to read and reason about existing pipelines quickly.\n\n- Mandatory (Communication) : Must be able to act as the client-facing Databricks technical point of contact and explain technical trade-offs in plain terms to non-technical stakeholders.\n\n- Mandatory (Note) : CTC is inclusive of 20% variable.\n\n- Preferred (Domain) : Pharma or life sciences background.\nSkills\nAzure Databricks, Data Engineering, Data Pipeline, PySpark, Data Build Tool, SQL, Data Ingestion","description_format":"text","description_chars":4724,"description_truncated":false,"requirements":{"experience_years_min":6,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["IT Consulting & Digital Transformation"],"lifecycle":[{"event":"open","at":"2026-10-18T01:22:52Z"}],"visa":[],"liveness":{"score":4,"band":"cold","label":"Long shot","p_open":0.4,"p_active":0.348,"p_room":0.28,"age_days":83,"expected_fill_days":24,"reasons":["seen:83","velocity","win:tail","crowd:"],"computed_at":"2026-10-23T05:54:15Z"},"pay":null,"html_url":"https://alion.io/job/absi-usa-databricks-architectengineer","json_url":"https://alion.io/job/absi-usa-databricks-architectengineer.json","meta":{"generated_at":"2026-10-24T00:05:38Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":110,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-25T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":3800495},"rest":"https://alion.io/mcp/rest/get_company?id=3800495"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fabsi-usa-databricks-architectengineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fabsi-usa-databricks-architectengineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fabsi-usa-databricks-architectengineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/absi-usa-databricks-architectengineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fabsi-usa-databricks-architectengineer"}]}