Senior QA Engineer – AI Agentic Workflows
Confirmed on the employer's own hiring board on Oct 29, 2026. First seen by Alion on Oct 13, 2026. Kake scores B on the Alion truth index.
Summary
We’re looking for a QA Engineer to help ensure quality and reliability across a rapidly evolving application ecosystem. In this role, you will be responsible for manually testing and validating code changes generated by an agentic pipeline that continuously listens to customer friction from support channels (chat and voice) and produces direct code fixes from transcripts. Because these automated changes impact multiple areas of the codebase, you will work closely with cross-functional teams to perform rigorous exploratory testing, design thorough test scenarios, and maintain high confidence in production releases. This position is ideal for a proactive quality engineer with strong analytical skills, deep customer empathy, and a "doer" mindset who thrives in dynamic environments.
Core Requirements
Experience manually validating code changes and software behaviors generated by automated or agentic workflows listening to customer friction from support transcripts across chat and voice channels.
Ability to collaborate and communicate effectively across many different engineering and product teams to manage and test wide-ranging code changes.
Strong foundation in manual testing methodologies, exploratory testing, test case design, and end-to-end quality assurance practices across web, mobile, or backend applications.
Demonstrated high level of agency and a proactive "doer" mentality, with the ability to hit the ground running and own functional quality end-to-end.
Ability to quickly understand diverse application flows, identify edge cases, and perform comprehensive regression testing across complex multi-system environments.
Experience defining and executing detailed manual test plans for diverse change types, ranging from frontend UI adjustments to backend business logic and API behaviors (e.g., using Postman or browser developer tools).
Strong product sense and deep customer empathy to effectively evaluate software behavior against real-world user friction points and support scenarios.
Comfort navigating fast-paced, highly dynamic environments and adapting manual test coverage as feedback loops iterate rapidly.
Excellent issue-tracking skills, including writing clear, reproducible bug reports and working closely with developers to drive root-cause resolution.
- Excellent verbal communication skills in fluent English.
High attention to detail with a relentless focus on minimizing production bugs and user impact.
Nice to Have
Familiarity with test automation principles, scripting languages (e.g., Python, JavaScript/TypeScript), or automated testing frameworks (e.g., Playwright, Selenium, Cypress).
Familiarity with AI/LLM-driven software development workflows, agentic pipelines, or prompt-based code generation systems.
Experience analyzing support transcripts, customer service logs, or NLP outputs to inform manual test scenarios.
Exposure to CI/CD pipelines and modern continuous deployment workflows.
Background working with event-driven architectures, microservices, or complex distributed systems.
Additional
US Timezone Overlap: 6-8 hours overlap with PST.
Please Note: Due to the high volume of applications, only shortlisted candidates will be contacted.