{"id":2673222,"url":"https://alion.io/job/ltm-senior-specialist-data-engineering-4","title":"Senior Specialist - Data Engineering","company":{"id":9353,"name":"LTM","domain":"ltm.com","url":"https://alion.io/company/ltm","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"RippleHire","truth_index":{"grade":"B","score":81,"open_postings":163,"ghost_share":0,"stale_share":0.773,"repost_share":0,"time_to_fill_p50_days":52,"computed_at":"2026-10-17T05:46:00Z"}},"role":"Data Science","role_family":"Data Science","seniority":"senior","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Coimbatore, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":21000,"max_usd":42000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":59},"experience_years_min":8,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Apache Kafka","optional":false},{"name":"Delta Lake","optional":false},{"name":"ETL/ELT","optional":false},{"name":"Incident Management","optional":false},{"name":"Informatica","optional":false},{"name":"ITIL","optional":false},{"name":"pySpark","optional":false},{"name":"SLI/SLO/SLA","optional":false},{"name":"Spark","optional":false},{"name":"SQL","optional":false},{"name":"Python","optional":true}],"status":"live","first_seen_at":"2026-09-24T00:00:00Z","employer_posted_date":"2026-10-16","last_verified_at":"2026-10-18T17:05:57Z","board_verified":true,"closed_at":null,"days_open":24,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":24},"description":"Role: PySpark Application Support Lead\nExperience: 8-12 Years\nLocation :Anywhere in India\nFocus Production Support Troubleshooting Optimization Team Leadership\nRole Summary\nLeadership Skills and proven experience in leading technical teams handling escalations and conducting knowledgesharing sessions The Pyspark Application support is responsible for the monitoring and troubleshooting Pyspark Jobs on the Cloudera environment This role ensures high availability performance and security of ETL services while supporting developers analysts and business users across environments Prod and Nonprod\nTechnical Skills Primary\nPySpark Application support\nHandson experience with Pyspark jobs development ETL support\nMonitor PySpark batch jobs streaming pipelines and scheduled workflows Airflow ADF Oozie etcChecking for failures and performance degradation\nTroubleshoot job failures performance degradation schema mismatches data quality issues\nResolve errors related to Spark SQL DataFrame transformations cluster configuration and storage layers\nHandle failures caused by upstreamdownstream systems Kafka Delta Lake Hive S3ADLS etc\nCoordinating with development team for fixing the failures\nCoordinating with QA team on data validation failures\nSupporting in production release and change management process\nIncident Problem Management\nRoot cause analysis for recurring issues\nPerformance tuning at a basic level cache queues agents\nFamiliarity with ITIL processes for AMS support\nTools\nTicketing systems ServiceNowJira\nMonitoring tools\nVersion control basics GitSVN for migration scripts\nSoft Skills\nAbility to work with client stakeholders\nGood communication with analytical and problemsolving skills\nAbility to Effectively interact with stakeholders colleagues and other members of the team\nDemonstrated ability to be organized and selfdirected\nStrong interpersonal skills with the ability to work cross functionally\nResponsibilities\nMonitoring Maintenance\nProactively monitor Informatica environments for uptime and performance\nExecute scheduled health checks and housekeeping tasks\nMaintain logs and escalate anomalies promptly\nIncident Management\nRespond to incidents within SLA timelines\nPerform initial triage resolve L2 issues and escalate L3 as needed\nDocument RCA and preventive measures\nUser Support\nAssist users with access issues report failures and portal navigation\nManage user provisioning and security roles\nChange Release Support\nSupport deployments and migrations between environments\nValidate postdeployment checks and rollback plans\nCompliance Documentation\nEnsure adherence to security and audit requirements\nMaintain SOPs runbooks and knowledge base for AMS operations\nProduction Support Incident Management Act as the primary point of contact for highpriority incidents debugging and resolving complex PySpark application issues in production\nTechnical Leadership Lead the efforts to design build and configure improvements to existing data pipelines and applications\nTeam Management Mentorship Guide mentor and manage a team of support specialistsdevelopers to achieve operational excellence and meet project deadlines\nPerformance Optimization Analyze existing PySpark applications and data pipelines for performance bottlenecks and implement optimization techniques eg Spark UI analysis tuning executors\nStakeholder Interaction Collaborate with crossfunctional teams developers Data Engineers DevOps to ensure seamless application functionality\nDocumentation Best Practices Create maintain and update technical documentation standard operating procedures SOPs and ensure code compliance with best practices\nAutomation Implement monitoring improvements and automate recurring manual tasks","description_format":"text","description_chars":3714,"description_truncated":false,"requirements":{"experience_years_min":8,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Media & Entertainment","Creative Agencies","Branding","Enterprise Apps Implementation Partners"],"lifecycle":[{"event":"open","at":"2026-10-16T04:28:04Z"}],"visa":[],"liveness":{"score":35,"band":"fade","label":"Fading","p_open":1,"p_active":0.391,"p_room":0.9,"age_days":23,"expected_fill_days":52,"reasons":["conf:1","stale_co","evergreen","wave","velocity","win:mid","comp:brand"],"computed_at":"2026-10-17T05:46:00Z"},"pay":null,"html_url":"https://alion.io/job/ltm-senior-specialist-data-engineering-4","json_url":"https://alion.io/job/ltm-senior-specialist-data-engineering-4.json","meta":{"generated_at":"2026-10-18T18:42:51Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":23108,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-19T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":9353},"rest":"https://alion.io/mcp/rest/get_company?id=9353"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fltm-senior-specialist-data-engineering-4"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fltm-senior-specialist-data-engineering-4"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fltm-senior-specialist-data-engineering-4"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ltm-senior-specialist-data-engineering-4\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fltm-senior-specialist-data-engineering-4"}]}