{"id":3055710,"url":"https://alion.io/job/penguin-solutions-qa-manager-software-engineering","title":"QA Manager, Software Engineering","company":{"id":178085,"name":"Penguin Solutions","domain":"penguinsolutions.com","url":"https://alion.io/company/penguin-solutions","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SuccessFactors","truth_index":null},"role":"QA","role_family":"QA","seniority":"lead","employment_type":null,"work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Bengaluru, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":17500,"max_usd":51000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":9},"experience_years_min":12,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"DeepEval","optional":false},{"name":"Function Calling","optional":false},{"name":"Hallucination","optional":false},{"name":"HPC","optional":false},{"name":"Human-in-the-Loop","optional":false},{"name":"Kubernetes","optional":false},{"name":"LangChain","optional":false},{"name":"LangSmith","optional":false},{"name":"Linux","optional":false},{"name":"LLM","optional":false},{"name":"LLM Guardrails","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Promptfoo","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Ragas","optional":false},{"name":"Red Teaming","optional":false},{"name":"Shift-Left Security","optional":false},{"name":"Synthetic Data","optional":false},{"name":"Ansible","optional":true},{"name":"InfiniBand","optional":true},{"name":"SLURM","optional":true}],"status":"live","first_seen_at":"2026-10-22T03:28:42Z","employer_posted_date":"2026-10-21","last_verified_at":"2026-10-25T13:42:17Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"At Penguin Solutions (Nasdaq: PENG) - The AI Factory Platform Company - we’re building a team of innovators who thrive on collaboration, creativity, and the opportunity to help shape the future of AI. As part of the AI technology revolution, our teams design, build, deploy, and manage AI factories for enterprises, sovereign AI initiatives, and neocloud providers worldwide.\nHeadquartered in Silicon Valley, California, Penguin Solutions operates globally through a network of R&D, manufacturing, and sales locations. For nearly three decades, we have operated at the intersection of memory and AI/HPC infrastructure. That engineering expertise positions us to power the next generation of AI workloads, from training to inference and agentic AI at scale.\nPenguin Solutions brings together differentiated infrastructure software, advanced memory, compute systems, end-to-end services, and industry-leading partner solutions in a full-stack AI factory platform designed to help customers deploy and scale AI workloads with speed and precision.\nAt Penguin Solutions, we value ideas over hierarchy and believe in servant leadership, where leaders enable teams to do their best work. We empower employees to take ownership, drive innovation, and grow through challenging work, continuous learning, and exposure to advanced AI tools and technologies. With flexibility where it matters and a strong focus on outcomes, Penguin Solutions is a place to do your best work, grow your career, and make a meaningful impact.\nJob Overview\nWe are seeking a Manager, Quality Engineering to lead quality engineering for ClusterWareAI, a critical component of the Penguin Solutions AI Factory Platform.\nClusterWareAI enables automated provisioning, orchestration, monitoring, and lifecycle management of large-scale AI infrastructure. In this role, you will define and drive the quality strategy for a complex distributed platform spanning GPU infrastructure, compute, networking, storage, Kubernetes, workload orchestration, and AI-enabled operations.\nThis is a hands-on technical leadership role. You will lead and develop a Quality Engineering team while partnering closely with Software Engineering, Product Management, Platform Engineering, DevOps, Support, and Systems Integration teams to build quality into every stage of the product lifecycle.\nThe ideal candidate brings a strong product-engineering mindset, deep experience with test automation and distributed systems, and a passion for delivering reliable cloud and infrastructure software at scale.\nResponsibilities\nOwn the end-to-end Quality Engineering strategy for ClusterWareAI across functional, integration, system, regression, performance, scalability, reliability, security, and resilience testing.\nLead, mentor, and grow a high-performing QE team while establishing strong technical, automation, and execution practices.\nDrive a shift-left, automation-first quality culture, partnering with Engineering, Product, Platform, DevOps, Support, and Systems Integration throughout the product lifecycle.\nDesign scalable test automation frameworks across APIs, UI, CLI, control-plane services, infrastructure integrations, and end-to-end workflows, integrated with CI/CD quality gates.\nDefine test strategies for GPU infrastructure, bare metal, Kubernetes, networking, storage, workload orchestration, and distributed systems at scale.\nValidate infrastructure lifecycle workflows including provisioning, configuration, upgrades, rollback, deprovisioning, monitoring, health management, and automated remediation.\nDrive performance, scalability, HA, fault-injection, longevity, and failure/recovery testing across large-scale distributed environments.\nDefine validation for multi-tenancy, tenant isolation, security, access controls, resource governance, and workload separation.\nEstablish quality and release-readiness metrics covering automation, escaped defects, test reliability, performance, scalability, and product risk.\nPartner with Support and Engineering on customer issues, root-cause analysis, and converting field failures into automated regression coverage.\nEvaluate and adopt AI-assisted quality engineering approaches to improve test generation, failure analysis, defect triage, and engineering productivity.\nAI / Agentic Quality Engineering\nOwn the AI Quality Engineering strategy for ClusterWareAI's AI Platform capabilities.\nBuild automated AI evaluation frameworks and benchmark suites covering accuracy, groundedness, consistency, reliability, latency, cost, and task success.\nEstablish LLM and agent evaluation methodologies using golden datasets, scenario-based testing, synthetic data, LLM-as-a-Judge, rubric-based evaluation, and human evaluation.\nTest RAG, tool calling, multi-step agents, planning/execution, agent collaboration, memory, and infrastructure-aware reasoning.\nDevelop AI regression pipelines to detect degradation caused by changes to models, prompts, agents, tools, knowledge sources, and orchestration logic.\nDrive AI safety and adversarial testing, including hallucination, prompt injection, unauthorized tool use, policy violations, data leakage, and unsafe infrastructure actions.\nValidate agent guardrails, policy enforcement, approvals, authorization boundaries, tenant isolation, auditability, and human-in-the-loop controls.\nEstablish production AI quality metrics including task success rate, hallucination rate, tool-call accuracy, agent failure rate, escalation rate, latency, and cost efficiency.\nDevelop scenario-based autonomous infrastructure testing to validate that agents correctly observe, reason, plan, obtain approval, execute authorized actions, verify outcomes, and recover safely from failures.\nQualifications\nBachelor's degree in Computer Science, Engineering, or equivalent practical experience.\n12+ years in Quality Engineering, Software Engineering, Test Automation, or related engineering roles, with 3+ years leading QE teams.\nProven experience owning quality for a commercial software, cloud, infrastructure, or distributed systems platform.\nStrong programming and automation skills, preferably Python, with experience building scalable automation frameworks.\nStrong experience testing APIs, distributed systems, cloud platforms, Kubernetes, infrastructure software, and complex enterprise applications.\nExperience with CI/CD, performance, scalability, reliability, HA, security, and failure/recovery testing.\nStrong Linux, debugging, observability, log analysis, and distributed-systems troubleshooting skills.\nDemonstrated ability to provide technical leadership, coaching, and team development.\nHands-on experience with AI/LLM quality engineering, AI evaluation, or testing AI-powered applications.\nExperience testing LLM applications, RAG, AI agents, multi-agent systems, or agentic workflows.\nExperience with AI evaluation methodologies including golden datasets, benchmark testing, LLM-as-a-Judge, RAG evaluation, adversarial testing, and red teaming.\nExperience with frameworks such as DeepEval, Ragas, Promptfoo, LangSmith/LangChain evaluation, NVIDIA NeMo Guardrails, or equivalent.\nUnderstanding of AI failure modes including hallucination, prompt injection, non-determinism, tool-use errors, context failures, model regression, and unsafe agent behavior.\nExperience integrating AI evaluation and regression testing into CI/CD pipelines.\nPreferred Qualifications\nExperience with AI infrastructure, GPU cloud/neocloud platforms, or large-scale cloud infrastructure.\nExperience with Kubernetes, container orchestration, and multi-tenant cloud platforms.\nExperience with GPU infrastructure, including GPU lifecycle, drivers, firmware, health monitoring, and heterogeneous accelerator environments.\nExperience with high-performance networking technologies such as InfiniBand, RDMA/RoCE, high-speed Ethernet, and distributed storage.\nExperience with bare-metal provisioning, infrastructure lifecycle management, and fleet-scale automation.\nExperience with workload orchestration and scheduling technologies such as Kubernetes and Slurm.\nExperience with infrastructure automation and Infrastructure as Code technologies such as Ansible.\nExperience with cloud platform security, tenant isolation, identity/access controls, and resource governance.\nExperience with observability, SRE practices, service-level objectives, high availability, fault tolerance, and automated remediation.\nExperience testing AI/LLM-powered capabilities and developing repeatable AI evaluation frameworks.\nBackground in enterprise infrastructure, cloud platforms, systems management software, or High Performance Computing environments.\nLocation\nHybrid - Bangalore, India\nTravel\nAs needed","description_format":"text","description_chars":8686,"description_truncated":false,"requirements":{"experience_years_min":12,"management_years_min":3,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":true},"security_clearance":false,"languages":[]},"benefits":["Continuous learning"],"hiring_locations":[],"hiring_excludes":[],"relocation_offered":false,"industries":["Artificial Intelligence","Education","LLM & Generative AI","High-Performance Computing"],"lifecycle":[{"event":"open","at":"2026-10-22T03:28:42Z"}],"visa":[],"liveness":{"score":90,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.903,"p_room":1,"age_days":3,"expected_fill_days":19,"reasons":["conf:0","velocity","win:early"],"computed_at":"2026-10-25T05:49:26Z"},"pay":null,"html_url":"https://alion.io/job/penguin-solutions-qa-manager-software-engineering","json_url":"https://alion.io/job/penguin-solutions-qa-manager-software-engineering.json","meta":{"generated_at":"2026-10-25T17:50:34Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":25505,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-26T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":178085},"rest":"https://alion.io/mcp/rest/get_company?id=178085"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fpenguin-solutions-qa-manager-software-engineering"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fpenguin-solutions-qa-manager-software-engineering"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fpenguin-solutions-qa-manager-software-engineering"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/penguin-solutions-qa-manager-software-engineering\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fpenguin-solutions-qa-manager-software-engineering"}]}