{"id":3299671,"url":"https://alion.io/job/crisil-senior-data-engineering","title":"Senior Data Engineering","company":{"id":1803904,"name":"CRISIL","domain":"crisil.com","url":"https://alion.io/company/crisil","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Mumbai, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":19000,"max_usd":42000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":75},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"Dimensional Modeling","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Scala","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Terraform","optional":false},{"name":"Agile","optional":true}],"status":"live","first_seen_at":"2026-10-26T21:52:14Z","employer_posted_date":null,"last_verified_at":"2026-10-26T21:52:14Z","board_verified":false,"closed_at":null,"days_open":4,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":4},"description":"Senior Data Engineering Manager About the RoleWe are seeking a Senior Data Engineering Manager to provide technical leadership for the design, implementation, and evolution of our next-generation data platform on Databricks.\nAs the Lead Data Engineer, you will be accountable for establishing engineering best practices, shaping architectural decisions, and driving the successful delivery of enterprise-scale data solutions. You will act as the technical authority for data engineering, partnering closely with Architects, Product teams, Technology teams, and business stakeholders to ensure the platform remains scalable, secure, cost-effective, and aligned to strategic business objectives.\nYou will combine hands-on engineering expertise with technical leadership, guiding a team of data engineers through platform migration, solution design, and delivery excellence while helping transform the organisation's data capabilities.\n What the Job InvolvesInitially reporting to the Director of Data Transformation, you will be responsible for:\n Technical Leadership & Platform OwnershipOwn the technical direction of the Databricks data platform and establish engineering standards across all data engineering initiatives.\nLead architecture and design decisions for enterprise-scale data products and platform capabilities.\nDefine reference architectures, reusable design patterns, and engineering guardrails for data ingestion, transformation, orchestration, governance, observability, and deployment.\nAct as the senior technical escalation point for complex engineering challenges.\n Team Leadership & Engineering ExcellenceLead, coach, and mentor a team of data engineers, fostering technical growth and engineering excellence.\nDrive engineering best practices through code reviews, technical design reviews, pair programming, and knowledge sharing.\nPromote a culture of quality, ownership, continuous improvement, and delivery excellence.\nSupport recruitment, onboarding, capability development, and succession planning within the engineering team.\n Databricks Platform StrategyServe as the organisation's subject matter expert for Databricks and Lakehouse architecture.\nDrive adoption of Databricks capabilities including Delta Lake, Unity Catalog, Workflows, Lakeflow, SQL Warehouses, Serverless Compute, and emerging platform capabilities.\nDefine the roadmap for platform optimisation, scalability, reliability, and cost efficiency.\nPartner with enterprise architecture to shape future-state data platform strategy.\n Data Governance & SecurityLead implementation of enterprise data governance standards using Unity Catalog and associated governance capabilities.\nEnsure secure, compliant, and auditable data access patterns across all environments.\nDefine policies and standards for metadata management, lineage, data quality, and regulatory compliance.\n Delivery LeadershipLead technical delivery of strategic data transformation initiatives and migration programmes.\nWork closely with Product Managers, Architects, and business stakeholders to translate business outcomes into technical solutions.\nManage technical dependencies, risks, and architectural decisions across multiple workstreams.\nEnsure solutions are delivered to agreed standards for performance, reliability, scalability, and maintainability.\n Engineering Operations & AutomationEstablish and maintain DevOps and DataOps standards across the platform.\nLead CI/CD adoption, Infrastructure-as-Code implementation, automated testing, release governance, and operational monitoring.\nDrive platform observability, performance optimisation, reliability engineering, and operational excellence.\n Requirements Essential Experience8-12 years experience in Data Engineering, including significant experience leading engineering teams and driving large-scale data platform initiatives.\nDemonstrated experience as a Lead Data Engineer, Technical Lead, Principal Engineer, or equivalent senior engineering position.\nProven experience architecting and delivering modern data platforms using Databricks.\n Technical SkillsDeep expertise in Apache Spark (PySpark, Spark SQL, Scala).\nExpert-level knowledge of Delta Lake and Lakehouse architecture patterns.\nAdvanced proficiency in Python and SQL.\nStrong experience with cloud-native data platforms, ideally AWS.\nProven expertise implementing Unity Catalog and enterprise governance frameworks.\nExperience with Infrastructure as Code using Terraform.\nStrong understanding of data warehousing, dimensional modelling, and data architecture principles.\nExperience implementing modern DataOps, DevOps, CI/CD, and automated testing practices.\n Leadership SkillsAbility to lead and influence engineering teams without compromising hands-on technical credibility.\nExperience shaping engineering operating models, standards, and governance processes.\nStrong stakeholder management skills across business, technology, architecture, and executive audiences.\nProven ability to influence senior leadership and drive strategic technology decisions.\n Nice to HaveDatabricks Certified Data Engineer Professional.\nDatabricks Certified Lakehouse Platform Architect.\nExperience with MLOps and AI Engineering platforms.\nExperience leading enterprise migration programmes from legacy data platforms.\nFinancial Services, Data Analytics, Benchmarking, or Information Services industry experience.\nExperience working in scaled Agile environments and PI Planning.","description_format":"text","description_chars":5444,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Credit Bureaus & Rating Agencies","Financial Data & Market Intelligence"],"lifecycle":[{"event":"open","at":"2026-10-26T23:09:45Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":4,"expected_fill_days":28,"reasons":["seen:4","velocity","win:early"],"computed_at":"2026-10-31T05:58:55Z"},"pay":null,"html_url":"https://alion.io/job/crisil-senior-data-engineering","json_url":"https://alion.io/job/crisil-senior-data-engineering.json","meta":{"generated_at":"2026-10-31T13:06:13Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":20363,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-01T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":1803904},"rest":"https://alion.io/mcp/rest/get_company?id=1803904"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fcrisil-senior-data-engineering"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fcrisil-senior-data-engineering"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fcrisil-senior-data-engineering"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/crisil-senior-data-engineering\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fcrisil-senior-data-engineering"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3299671}},{"tool":"search_jobs","arguments":{"company":"crisil.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3299671},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}