{"id":4523456,"url":"https://alion.io/job/ey-techops-cloudops-data-platform-and-engineering-support","title":"TechOps-CloudOps-Data Platform and Engineering Support","company":{"id":2859,"name":"EY","domain":"ey.com","url":"https://alion.io/company/ey-com","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"DevOps","role_family":"DevOps","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Kochi, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":5,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AWS","optional":false},{"name":"CI/CD","optional":false},{"name":"Databricks","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Git","optional":false},{"name":"Incident Management","optional":false},{"name":"MS SQL","optional":false},{"name":"Oracle","optional":false},{"name":"pySpark","optional":false},{"name":"Python","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Azure","optional":true},{"name":"Copilot Studio","optional":true},{"name":"FinOps","optional":true},{"name":"LangChain","optional":true},{"name":"LangGraph","optional":true},{"name":"MLFlow","optional":true},{"name":"OpenAI","optional":true},{"name":"PowerShell","optional":true},{"name":"Rest API","optional":true},{"name":"Terraform","optional":true}],"status":"live","first_seen_at":"2026-11-18T09:30:15Z","employer_posted_date":"2026-11-18","last_verified_at":"2026-11-18T09:30:15Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.\nTechOps - CloudOps - Data Platform & Engineering Support Engineer: Senior\nAt EY, we’re all in to shape your future with confidence.\nWe’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go.\nJoin EY and help to build a better working world.\nAbout Global Delivery Services\nGlobal Delivery Services refers to EY's worldwide network of service delivery centers. The GDS team plays an important role in EY’s strategy by ensuring effective support to EY’s growth agenda.\nOur journey started in 2002 with approximately 200 people. Today we stand at 80,000+ professionals in ten locations around the world. We operate in Argentina, China, Hungary, India, Philippines, Poland, Sri Lanka, Mexico, Spain and the United Kingdom.\nClient service is focused on providing Consulting, Assurance, Tax, Strategy & Transactions, and Knowledge support to our clients around the world. The teams enable account teams worldwide to provide seamless, high-quality, value-added support, helping deliver exceptional client service.\nEnablement Services provides cost-effective, high-skilled, and innovative services to support EY’s global and local enablement teams. Markets, BMC, AWS, Finance and Accounting, Risk Management, Procurement, People Shared Services, IT Service Delivery and IT Global Infrastructure services, are among the services offered by Enablement Services.\nOur innovation specialists serve the GDS Client Service and Enablement Services teams, along with Service Lines, Core Business Services and Sectors. The team brings the desired environment, technologies and skilled teams together for facilitation, rapid prototyping and innovative thinking. The competencies offered include analytics, digital, user experience, mobile technology, infrastructure, Microsoft technologies and open innovation.\nThe opportunity\nWe are looking for a seasoned and proactive Senior Data Platform & Engineering Support Engineer to provide production and operational support for enterprise data platforms and engineering workloads, with a primary focus on Databricks, Python, PySpark, and ETL solutions. The role will combine hands-on troubleshooting of jobs, notebooks, clusters, pipelines, code, SQL, and data issues with Databricks platform administration, performance optimization, release support, and continuous service improvement. The engineer will act as an escalation point for complex incidents and collaborate with data engineering, cloud platform, security, database, DevOps, and business teams to maintain reliable, secure, and cost-effective data services.\nYour key responsibilities\nProvide day-to-day production and operational support for Databricks workspaces, jobs, notebooks, workflows, Delta Live Tables or Lakeflow pipelines, clusters, SQL warehouses, libraries, repositories, and related integrations.\nMonitor scheduled and streaming workloads, identify failed, delayed, or degraded jobs, assess business impact, restore services, and coordinate recovery within agreed service levels.\nTroubleshoot Python and PySpark code failures, dependency conflicts, serialization issues, memory errors, data-skew problems, schema changes, malformed records, and source-to-target transformation defects.\nInvestigate cluster start-up failures, driver and executor errors, autoscaling issues, pool and policy constraints, runtime incompatibilities, library installation failures, and workspace connectivity problems.\nSupport ETL and ELT pipelines across ingestion, transformation, validation, orchestration, and publishing layers, including batch and streaming processing.\nPerform root cause analysis for recurring incidents and implement permanent corrective actions, preventive monitoring, code or configuration improvements, and operational controls.\nOptimize Databricks workload performance through Spark UI analysis, execution-plan review, partitioning, file sizing, caching, broadcast joins, adaptive query execution, data skipping, clustering, and appropriate compute sizing.\nProvide Databricks platform administration support covering workspace configuration, cluster policies, compute governance, runtime management, libraries, groups, permissions, service principals, secrets, tokens, and access troubleshooting.\nSupport Unity Catalog administration, including catalogs, schemas, tables, volumes, privileges, external locations, storage credentials, lineage, and controlled access to governed data assets.\nOversee production deployments and environment promotions for notebooks, jobs, pipelines, configurations, and infrastructure changes using Git and CI/CD practices, with validation and rollback planning.\nCreate and maintain runbooks, standard operating procedures, monitoring checks, known-error records, troubleshooting guides, reconciliation controls, and knowledge articles.\nCollaborate with data engineers, platform administrators, DevOps teams, cloud infrastructure teams, database administrators, security teams, and business stakeholders to resolve issues and improve platform reliability.\nParticipate in platform health checks, capacity and cost reviews, disaster recovery exercises, release activities, and rotational on-call support.\nResponsible for decision-making, optimizing processes, resource management, and overseeing team management as needed for task execution.\nAccountable for allocating personnel, supervising team members, assigning tasks, ensuring that the team has the necessary tools and support to succeed in their roles and optimizing and evaluating their performance to meet organizational goals.\nSkills and attributes for success\nStrong hands-on experience with Databricks jobs, notebooks, workflows, pipelines, clusters, SQL warehouses, Spark UI, Delta Lake, and production troubleshooting.\nStrong Python and PySpark skills for code analysis, debugging, ETL development, data transformation, exception handling, logging, testing, and performance optimization.\nSolid understanding of Spark architecture, drivers, executors, stages, tasks, shuffles, partitions, caching, memory management, adaptive query execution, and common performance bottlenecks.\nStrong ETL and ELT knowledge, including ingestion patterns, orchestration, incremental processing, change data capture, data validation, error handling, restartability, and data reconciliation.\nGood SQL skills for data analysis, source-to-target validation, reconciliation, query tuning, and incident diagnosis.\nWorking knowledge of Oracle and Microsoft SQL Server, including schemas, tables, views, stored procedures, indexes, privileges, connectivity, and execution plans.\nPractical knowledge of Databricks platform administration, workspace security, identity and access management, secrets, cluster policies, runtime upgrades, and compute governance.\nAbility to interpret Databricks, Spark, Python, application, database, operating-system, and cloud-service logs to isolate failures across multiple technology layers.\nStrong analytical and problem-solving skills with a disciplined approach to incident management, root cause analysis, and preventive improvement.\nClear communication and stakeholder-management skills, including the ability to explain technical issues, business impact, recovery status, and corrective actions.\nAbility to mentor junior engineers, coordinate incident resolution, review technical solutions, and promote operational engineering standards.\nTo qualify for the role, you must have\nBachelor’s degree in computer science, data engineering, information systems, engineering, or a related discipline, or equivalent professional experience.\n5-8 years of experience in data engineering, data-platform support, ETL development, application management, or production operations.\nStrong hands-on experience supporting Databricks workloads in production, including jobs, notebooks, clusters, workflows, pipelines, and SQL workloads.\nStrong programming and troubleshooting experience with Python and PySpark.\nExperience supporting ETL or ELT pipelines, including job failures, dependencies, data-quality issues, reconciliation, reruns, and performance problems.\nExperience with Databricks platform administration, including workspace access, compute configuration, cluster policies, libraries, secrets, service principals, and Unity Catalog.\nPractical experience using SQL with Oracle, SQL Server, or comparable relational databases for investigation, validation, and performance analysis.\nExperience leading complex incident resolution, root cause analysis, problem management, change implementation, and production release support.\nExperience working with Git-based development, CI/CD pipelines, environment promotion, and controlled production deployments.\nExperience working with distributed teams and supporting business-critical data services under agreed SLAs.\nWillingness to participate in 24/7 support rotations or cover critical business hours when required.\nTechnologies and Tools\nMust have\nDatabricks: workspaces, notebooks, jobs, Workflows, Lakeflow or Delta Live Tables pipelines, all-purpose and job clusters, instance pools, cluster policies, Databricks SQL, SQL warehouses, Spark UI, Delta Lake, and production troubleshooting.\nDatabricks platform administration: users, groups, service principals, entitlements, permissions, secrets, tokens, libraries, runtime management, compute governance, workspace configuration, and access troubleshooting.\nUnity Catalog: catalogs, schemas, tables, views, volumes, privileges, external locations, storage credentials, lineage, and governed data access.\nPython and PySpark for ETL development, code troubleshooting, logging, testing, dependency management, exception handling, and performance optimization.\nETL and ELT engineering covering batch and streaming ingestion, transformations, orchestration, incremental processing, data validation, restartability, and reconciliation.\nKnowledge of agentic AI concepts and AI-assisted operational workflows, including enterprise AI agents for job-failure triage, log analysis, Spark diagnostics, data-quality investigation, reconciliation, runbook guidance, and knowledge retrieval.\nOracle, Microsoft SQL Server, and strong SQL skills for data validation, query analysis, reconciliation, connectivity troubleshooting, and incident diagnosis.\nGit and CI/CD practices for notebook, code, job, pipeline, and configuration deployment across controlled environments.\nGood to have\nExposure to Databricks Mosaic AI, Agent Framework, Model Serving, MLflow, Microsoft Copilot Studio, Microsoft Foundry/Azure OpenAI, LangChain, LangGraph, or equivalent AI and agent orchestration technologies.\nAwareness of responsible AI practices, including human oversight, secure data access, privacy, evaluation, traceability, auditability, and protection against unsafe automated operational actions.\nExperience with cloud services in Microsoft Azure or AWS, such as storage, networking, identity, key management, monitoring, and private connectivity used by Databricks.\nExperience with infrastructure as code and automation tools such as Terraform, Databricks Asset Bundles, REST APIs, CLI tools, PowerShell, or shell scripting.\nKnowledge of data observability, data quality, metadata, lineage, cost management, FinOps, or enterprise monitoring tools.\nRelevant certifications such as Databricks Certified Data Engineer Associate or Professional, Databricks Certified Associate Developer for Apache Spark, Azure Data Engineer Associate, AWS data engineering certifications, Oracle, or Microsoft SQL Server certifications.\nWhat we look for\nSenior support engineers who combine strong Databricks and dat...","description_format":"text","description_chars":15483,"description_truncated":true,"requirements":{"experience_years_min":5,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Continuous learning","Equity","Professional development"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Audit & Assurance Firms","Financial Advisory, Valuation & Restructuring","Management Consulting","Tax Advisory & Preparation"],"lifecycle":[{"event":"open","at":"2026-11-18T09:30:15Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":45,"reasons":["conf:2","win:early","comp:brand"],"computed_at":"2026-11-18T12:26:48Z"},"pay":null,"html_url":"https://alion.io/job/ey-techops-cloudops-data-platform-and-engineering-support","json_url":"https://alion.io/job/ey-techops-cloudops-data-platform-and-engineering-support.json","meta":{"generated_at":"2026-11-18T12:26:48Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6597,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":2859},"rest":"https://alion.io/mcp/rest/get_company?id=2859"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fey-techops-cloudops-data-platform-and-engineering-support"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fey-techops-cloudops-data-platform-and-engineering-support"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fey-techops-cloudops-data-platform-and-engineering-support"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ey-techops-cloudops-data-platform-and-engineering-support\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fey-techops-cloudops-data-platform-and-engineering-support"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4523456}},{"tool":"search_jobs","arguments":{"company":"ey.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4523456},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}