{"id":2328749,"url":"https://alion.io/job/qad-senior-qa-engineer-ai-agents-agentic-workflows","title":"Senior QA Engineer, AI Agents & Agentic Workflows","company":{"id":6493,"name":"QAD","domain":"qad.com","url":"https://alion.io/company/qad","size_band":"201-500","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"SmartRecruiters","truth_index":{"grade":"B","score":75,"open_postings":4,"ghost_share":0,"stale_share":1,"repost_share":0,"time_to_fill_p50_days":34,"computed_at":"2026-10-13T05:45:00Z"}},"role":"QA","role_family":"QA","seniority":"senior","employment_type":"full_time","work_mode":"hybrid","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Pune, India"],"countries":["IN"],"hiring_countries":[],"hiring_countries_total":0,"salary":null,"salary_estimate":{"min_usd":12000,"max_usd":29000,"period":"year","method":"role_seniority_country_remote_cell","sample_n":20},"experience_years_min":3,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"Function Calling","optional":false},{"name":"Hallucination","optional":false},{"name":"LLM","optional":false},{"name":"Multi-Agent Systems","optional":false},{"name":"Playwright","optional":false},{"name":"RAG","optional":false},{"name":"Selenium","optional":false},{"name":"Tool Use","optional":false}],"status":"live","first_seen_at":"2026-10-12T05:37:03Z","employer_posted_date":"2026-10-12","last_verified_at":"2026-10-14T01:16:27Z","board_verified":true,"closed_at":null,"days_open":1,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":1},"description":"QAD is building a world-class SaaS company, and we are growing. We are looking for talented individuals who want to join us on our mission to help solve relevant real-world problems in manufacturing and the supply chain.\nWe are a virtual first company and your primary work experience will be virtual / working from your home. Occasional travel to a physical office may be required to enhance working relationships, collaboration, design, strategy and alignment. \n QAD is seeking a Sr QA Engineer to own the continuous validation and quality of Champion Assist, a multi-\nagent AI product with ~20 evolving agents. You will test the agents themselves: their reasoning, tool use,\norchestration and handoffs, and the quality of their responses. This goes beyond UI and API checks. You will\ndesign evaluation frameworks and regression suites that catch failures unique to non-deterministic, LLM-\ndriven systems.\nResponsibilities:\nDesign, run and maintain end-to-end business scenarios that exercise multi-step agentic workflows,\nincluding agent routing, tool/function calls, and multi-turn conversations.\nEvaluate agent outputs for correctness, relevance, groundedness, consistency, tone and\ncompleteness, using both human review and automated methods.\nBuild and maintain eval datasets (golden sets, edge cases, adversarial prompts) and automated\nregression suites that run as agents, prompts, models and tools change.\nIdentify cross-agent, orchestration and integration issues: wrong agent selection, broken handoffs,\ntool-call failures, context loss, looping or runaway behavior.\nTest for hallucination, prompt injection, jailbreaks, data leakage and unsafe or out-of-scope responses.\nDetect regressions caused by model upgrades, prompt changes or retrieval/knowledge changes, and\nquantify them with metrics.\nTriage and root-cause issues with Engineering and Product, separating prompt, model, retrieval, tool\nand orchestration causes.\nRe-test fixes, validate the end-user experience, and keep evals current as the product evolves.\nDocument test strategy, eval results and quality trends clearly for global stakeholders.\nBachelor's degree in software engineering, computer science or a related field.\n3-5 years of QA experience, with at least 1-2 years testing LLM-based applications, AI agents or\nagentic workflows.\nHands-on experience evaluating non-deterministic outputs: defining pass/fail criteria, rubrics, and\nacceptance thresholds for AI responses.\nExperience building or maintaining AI eval or regression suites (e.g., LLM-as-judge, golden datasets,\nscoring rubrics).\nUnderstanding of agentic concepts: tool/function calling, multi-agent orchestration, planning,\nmemory/context, RAG.\nExperience with test automation tools (Selenium, Playwright, TestComplete or similar) and API testing.\n Your health and well being are important to us at QAD. We provide programs that help you strike a healthy work-life balance.\nOpportunity to join a growing business, launching into its next phase of expansion and transformation.\nCollaborative culture of smart and hard-working people who support one another to get the job done.\nAn atmosphere of growth and opportunity, where idea-sharing is always prioritized over level or hierarchy.\nCompensation packages based on experience and desired skill set\nAbout QAD:\nQAD | Redzone is redefining manufacturing and supply chains through its intelligent, adaptive platform that connects people, processes, and data into a single System of Action. With three core pillars - Redzone (frontline empowerment), Adaptive Applications (the intelligent backbone), and Champion AI (Agentic AI for manufacturing) - QAD | Redzone helps manufacturers operate with Champion Pace, achieving measurable productivity, resilience, and growth in just 90 days.\nQAD is committed to ensuring that every employee feels they work in an environment that values their contributions, respects their unique perspectives and provides opportunities for growth regardless of background. QAD’s DEI program is driving higher levels of diversity, equity and inclusion so that employees can bring their whole self to work.\nWe are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.","description_format":"text","description_chars":4430,"description_truncated":false,"requirements":{"experience_years_min":3,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[{"language":"English","level":"All levels","optional":false}]},"benefits":["Equity"],"hiring_locations":[{"name":"India","iso":"IN","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["ERP & Business Management Software","Supply Chain & Logistics Software","Manufacturing & Industrial Software"],"lifecycle":[{"event":"open","at":"2026-10-12T08:19:31Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":1,"expected_fill_days":34,"reasons":["conf:0","win:early"],"computed_at":"2026-10-13T05:45:00Z"},"pay":null,"html_url":"https://alion.io/job/qad-senior-qa-engineer-ai-agents-agentic-workflows","json_url":"https://alion.io/job/qad-senior-qa-engineer-ai-agents-agentic-workflows.json","meta":{"generated_at":"2026-10-14T03:56:25Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":6032,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-15T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":6493},"rest":"https://alion.io/mcp/rest/get_company?id=6493"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fqad-senior-qa-engineer-ai-agents-agentic-workflows"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fqad-senior-qa-engineer-ai-agents-agentic-workflows"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fqad-senior-qa-engineer-ai-agents-agentic-workflows"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/qad-senior-qa-engineer-ai-agents-agentic-workflows\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fqad-senior-qa-engineer-ai-agents-agentic-workflows"}]}