{"id":3776515,"url":"https://alion.io/job/ishan-technologies-gpu-cluster-reliability-engineer","title":"GPU Cluster Reliability Engineer","company":{"id":4493665,"name":"Ishan Technologies","domain":"ishantechnologies.co.in","url":"https://alion.io/company/ishan-technologies","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":null,"truth_index":null},"role":"AI/ML","role_family":"AI/ML","seniority":"middle","employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Ahmedabad, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":null,"experience_years_min":4,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Ansible","optional":false},{"name":"AWS","optional":false},{"name":"Bash","optional":false},{"name":"Docker","optional":false},{"name":"GCP","optional":false},{"name":"Grafana","optional":false},{"name":"Helm","optional":false},{"name":"HPC","optional":false},{"name":"Incident Management","optional":false},{"name":"JAX","optional":false},{"name":"Kubeflow","optional":false},{"name":"Kubernetes","optional":false},{"name":"Linux","optional":false},{"name":"Loki","optional":false},{"name":"Prometheus","optional":false},{"name":"Python","optional":false},{"name":"PyTorch","optional":false},{"name":"Red Hat","optional":false},{"name":"SLURM","optional":false},{"name":"Terraform","optional":false},{"name":"vLLM","optional":false}],"status":"live","first_seen_at":"2026-11-04T17:25:29Z","employer_posted_date":null,"last_verified_at":"2026-11-04T17:25:29Z","board_verified":false,"closed_at":null,"days_open":2,"trust":{"level":"not_scored","repost_count":null,"flags":[],"days_open":2},"description":"About the Role\nIshan Technologies is looking for an experienced Cluster Reliability Engineer to manage and maintain the compute infrastructure of Saksham AI Services 1000+ GPU cluster.\nThe role involves managing GPU servers, Linux infrastructure, Slurm and Kubernetes environments, cluster reliability, automation and MLOps operations. The selected candidate will play a key role in ensuring high availability, performance, scalability and reliability of AI training and inference workloads.\nThe position will also serve as an L2/L3 technical escalation point, working closely with the 24x7 NOC team, platform engineers, customers and technology partners.\nKey Responsibilities\n\n1. GPU Infrastructure & Server Management\nReceive, rack, configure and maintain GPU servers.\nManage BIOS, firmware, Linux OS images, GPU drivers and software libraries.\nPerform GPU server burn-in, hardware diagnostics and acceptance testing.\nMaintain consistent server configurations and manage firmware and security updates.\nCoordinate with OEM vendors for hardware faults, replacements and RMAs.\n2. Cluster Management – Slurm & Kubernetes\nAdminister and maintain Slurm and Kubernetes environments for AI training and inference workloads.\nManage Slurm controllers, partitions, QoS, fairshare and resource allocation.\nConfigure Kubernetes GPU Operator, device plugins, Helm and related operators.\nManage cluster upgrades, patching, tenant onboarding and scheduling.\nEnsure stable and efficient multi-tenant GPU cluster operations.\n3. Cluster Reliability & Monitoring\nDevelop and maintain GPU and node health checks.\nMonitor GPU errors, ECC events, RAS events and hardware failures.\nImplement automated fault detection and remediation mechanisms.\nDevelop monitoring dashboards and alerts using Prometheus, Grafana, Loki or ELK.\nMaintain cluster availability in line with the 99.9% uptime commitment.\nMaintain operational logs and monitoring records in accordance with applicable compliance requirements.\n4. MLOps & AI Workload Support\nBuild and maintain optimized framework images for PyTorch, JAX and vLLM.\nDevelop ready-to-use job templates for AI training and inference.\nConduct workload benchmarks and GPU performance testing.\nSupport distributed AI workloads, including data, tensor and pipeline parallelism.\nProvide technical assistance to customers and solution architects on workload performance and tooling.\n5. Incident Management & Automation\nHandle L2/L3 technical escalations from the 24x7 NOC team.\nLead incident investigations, root cause analysis and post-incident reviews.\nDevelop automation scripts using Python and Bash.\nMaintain operational runbooks and auto-remediation procedures.\nTrack capacity, GPU utilisation, goodput and service-level performance.\nIdentify recurring issues and implement long-term corrective actions.\n\nRequired Technical Skills\nStrong hands-on experience in Linux System Administration.\nExperience managing GPU servers, GPU drivers, firmware, BIOS and kernel configurations.\nHands-on experience with multi-GPU accelerator servers.\nStrong knowledge of Slurm administration and workload scheduling.\nExperience with Kubernetes administration for GPU workloads.\nKnowledge of GPU Operator, Helm, Kubeflow and KubeRay.\nFamiliarity with GPU monitoring, ECC/RAS events and vendor diagnostic tools.\nExperience with Prometheus, Grafana, Loki or ELK.\nWorking knowledge of PyTorch, JAX, vLLM and GPU collective communication libraries.\nExperience with Docker, Apptainer and container image management.\nAutomation experience using Python, Bash and Ansible or Terraform.\nFamiliarity with bare-metal provisioning tools such as MAAS, Ironic, Metal3 or Warewulf.\n\nEducational Qualifications\nBachelor's degree in Engineering or Technology.\nPreferred specialisations: Computer Science, Information Technology, Electronics or related disciplines.\nRelevant certifications in Linux, Kubernetes or GPU computing will be an added advantage.\n\nPreferred Certifications:\nCertified Kubernetes Administrator (CKA).\nRed Hat RHCSA/RHCE or Linux Foundation Certified System Administrator (LFCS).\nGPU vendor training or certifications.\n\nExperience Requirements\n4–8 years of overall IT infrastructure or engineering experience.\nMinimum 2+ years of relevant experience in GPU/HPC cluster operations, Site Reliability Engineering (SRE) or MLOps.\nHands-on experience with Linux GPU servers and Slurm and/or Kubernetes is essential.\nExperience supporting production environments with on-call and incident management responsibilities.\nExperience with multi-vendor data-centre GPU platforms will be an advantage.\nExposure to distributed AI training and inference workloads is preferred.\n\nPreferred Additional Exposure\nNVIDIA GPU ecosystem and related management tools.\nClusterMAX standards and CMAX audit tool.\nPublic cloud platforms such as GCP or AWS.\nHPC infrastructure and large-scale AI compute environments.\n\nKey Competencies\nStrong troubleshooting and problem-solving abilities.\nHands-on technical ownership and attention to detail.\nAbility to handle critical production incidents under pressure.\nStrong communication and coordination skills.\nWillingness to participate in a 24x7 on-call support rotation.\nAbility to learn and adapt to evolving GPU, HPC and AI technologies.","description_format":"text","description_chars":5261,"description_truncated":false,"requirements":{"experience_years_min":4,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":null,"security_clearance":false,"languages":[]},"benefits":[],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Information Technology"],"lifecycle":[{"event":"open","at":"2026-11-04T23:09:45Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":2,"expected_fill_days":26,"reasons":["seen:2","win:early"],"computed_at":"2026-11-07T05:47:08Z"},"pay":null,"html_url":"https://alion.io/job/ishan-technologies-gpu-cluster-reliability-engineer","json_url":"https://alion.io/job/ishan-technologies-gpu-cluster-reliability-engineer.json","meta":{"generated_at":"2026-11-07T07:28:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":2659,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-08T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":4493665},"rest":"https://alion.io/mcp/rest/get_company?id=4493665"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fishan-technologies-gpu-cluster-reliability-engineer"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fishan-technologies-gpu-cluster-reliability-engineer"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fishan-technologies-gpu-cluster-reliability-engineer"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/ishan-technologies-gpu-cluster-reliability-engineer\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fishan-technologies-gpu-cluster-reliability-engineer"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":3776515}},{"tool":"search_jobs","arguments":{"company":"ishantechnologies.co.in","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":3776515},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}