{"id":4659006,"url":"https://alion.io/job/bajaj-finserv-senior-data-engineer-10","title":"Senior Data Engineer","company":{"id":37114,"name":"Bajaj Finserv","domain":"bajajfinserv.in","url":"https://alion.io/company/bajaj-finserv","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Career site","truth_index":{"grade":"B","score":78,"open_postings":24,"ghost_share":0.042,"stale_share":0.958,"repost_share":0.042,"time_to_fill_p50_days":10,"computed_at":"2026-11-20T05:46:30Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Azure","optional":false},{"name":"Azure Data Factory","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"FastAPI","optional":false},{"name":"Pandas","optional":false},{"name":"Power BI","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"SQL","optional":false},{"name":".NET","optional":true},{"name":"Azure Cosmos DB","optional":true},{"name":"C#","optional":true},{"name":"Git","optional":true},{"name":"Spark","optional":true}],"status":"live","first_seen_at":"2026-05-29T00:00:00Z","employer_posted_date":"2026-11-20","last_verified_at":"2026-11-20T08:39:21Z","board_verified":true,"closed_at":null,"days_open":175,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":175},"description":"Job PurposeTo design and deliver AI-powered Business Intelligence solutions by integrating Databricks Genie, Semantic Models, and Metric Views on top of a robust end-to-end data engineering stack.\nThe role focuses on enabling self-service analytics using natural language (GenAI), ensuring business-friendly data consumption, and building governed, scalable, and high-performance data ecosystems across batch and real-time pipelines. Duties and Responsibilities\nKEY ROLES / PRINCIPAL ACCOUNTABILITIES\nAI for BI & GenAI Enablement\n• Design and implement GenAI-powered BI solutions using Databricks Genie or MS Fabric \n• Create and manage Data Rooms for business users with curated datasets \n• Define and maintain Instructions Layer (prompt engineering for business context) \n• Enable natural language to SQL/insights workflows for self-service analytics \n• Drive adoption of Databricks One & other platforms as a unified analytics interface \nSemantic Layer & Metrics Engineering\n• Design and manage Semantic Models for business abstraction \n• Develop reusable and governed Metric Views (KPIs, aggregations, business definitions) \n• Ensure consistency across BI tools (Power BI / Genie) \n• Align semantic layer with business glossary and data governance policies \nData Engineering & Platform Development\n• Build scalable pipelines using Azure Databricks (PySpark, SQL) \n• Develop and orchestrate ETL workflows using Azure Data Factory \n• Work with Delta Lake architecture (Bronze-Silver-Gold layers) \n• Enable real-time and batch data processing pipelines \n• Enable data exposure via APIs for BI and downstream systems \nCI/CD & DevOps\n• Implement CI/CD pipelines for data and AI workflows \n• Automate deployments across environments (Dev, QA, Prod) \n• Ensure version control and reproducibility \n________________________________________\n?\nKEY RESPONSIBILITIES\n• Translate business problems into AI-driven BI solutions \n• Own end-to-end delivery: ingestion ? transformation ? semantic layer ? AI consumption \n• Design scalable data architecture aligned with lakehouse principles \n• Ensure data quality, governance, and metric consistency \n• Collaborate with business teams to onboard them onto Genie-based analytics \n• Optimize performance of queries, pipelines, and AI responses \n• Establish best practices for AI in BI (prompting, semantic tuning, governance) \n• Drive adoption of self-service BI with minimal dependency on tech teamsKey Decisions / Dimensions\nKEY DECISIONS / DIMENSIONS\n• Define semantic layer design and metric definitions \n• Decide GenAI prompting strategies and instruction frameworks \n• Prioritize data vs AI optimization trade-offs \n• Handle production issues with RCA and long-term fixes \n• Drive architectural decisions for lakehouse + AI integrationMajor Challenges\nMAJOR CHALLENGES\n• Ensuring accuracy and trust in AI-generated insights \n• Driving adoption of GenAI-based BI over traditional dashboards \n• Maintaining semantic consistency across multiple tools \n• Balancing performance, cost, and scalability \n• Managing dependencies across data engineering, AI, and business teams Required Qualifications and Experience\nREQUIRED SKILLS & EXPERIENCE\nMust Have\n• Azure Databricks - PySpark, SQL, Delta Lake \n• Strong experience in Semantic Modeling & Metrics Layer design \n• Hands-on with Databricks Genie / GenAI-based BI workflows \n• Databricks One (Unified BI Experience) \n• Prompt Engineering / Instruction tuning for AI systems \n• Python (Pandas, PySpark, FastAPI) \n• Azure Data Factory (ADF) for ETL pipelines \n• Strong SQL and data modeling skills \nGood to Have\n• Cosmos DB / MongoDB (NoSQL concepts) \n• Azure Data Explorer (KQL) \n________________________________________\nDATA STACK (MANDATORY FOR SCREENING)\nSNo Data Platform / Concepts Associated Technologies\n1 Databricks Lakehouse PySpark, SQL, Delta Lake\n2 AI for BI Databricks Genie, Genie Rooms, Instructions, Agents\n3 Semantic Layer Semantic Models, Metric Views\n4 ETL & Orchestration Azure Data Factory\n5 Programming Python, C#/.NET\n6 Cloud Platform Azure (Preferred)\n10 DevOps CI/CD Pipelines, Git\n________________________________________\n?\nSOFT SKILLS\n• Strong analytical and problem-solving mindset \n• Ability to bridge business + data + AI \n• Effective stakeholder communication \n• Ownership-driven and proactive approach \n• Ability to work in fast-paced, evolving AI landscape","description_format":"text","description_chars":4372,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Business & SME Lending","Property & Casualty Insurance","Consumer Loans & Pawnshops","Life Insurance & Annuities"],"lifecycle":[{"event":"open","at":"2026-11-20T04:59:16Z"}],"visa":[],"liveness":{"score":3,"band":"cold","label":"Long shot","p_open":1,"p_active":0.12,"p_room":0.28,"age_days":175,"expected_fill_days":10,"reasons":["conf:0","stale_co","evergreen","velocity","win:tail","crowd:brand"],"computed_at":"2026-11-20T05:46:30Z"},"pay":null,"html_url":"https://alion.io/job/bajaj-finserv-senior-data-engineer-10","json_url":"https://alion.io/job/bajaj-finserv-senior-data-engineer-10.json","meta":{"generated_at":"2026-11-20T10:13:18Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":10309,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-21T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":37114},"rest":"https://alion.io/mcp/rest/get_company?id=37114"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fbajaj-finserv-senior-data-engineer-10"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fbajaj-finserv-senior-data-engineer-10"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fbajaj-finserv-senior-data-engineer-10"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/bajaj-finserv-senior-data-engineer-10\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fbajaj-finserv-senior-data-engineer-10"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4659006}},{"tool":"search_jobs","arguments":{"company":"bajajfinserv.in","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4659006},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}