Automation Test Architect - Playwright Testing
First seen by Alion on Sep 30, 2026.
Responsibilities :
- Own the end-to-end automation and AI testing strategy : framework selection, architecture, coding standards, branching and review model, and the quality gates.
- Design and lead a Playwright-based automation framework (TypeScript or C#), and drive a risk-prioritised modernisation.
- Stand up AI-assisted test engineering : multi-agent test case generation on AWS Bedrock/ OpenRouter with automated quality judging, agentic test execution playbooks, and GitHub Copilot-based agent workflows with human review disciplines that keep outputs trustworthy.
- Architect automated validation for third-party API data ingestions and batch jobs, including database-level assertions and synthetic test data strategy.
- Integrate everything into CI/CD on GitHub Actions, supporting the client's Bitbucket-to-GitHub migration as the test-side owner.
- Define the QA metrics catalogue, entry/exit criteria and definition of done with the client, then make every metric measurable from tooling.
- Be client-facing : present at governance forums, contribute to quarterly business reviews, mentor the pod's engineers, and act as the engagement's technical conscience.
Requirements :
- 8 - 12 years in QA/test engineering, with 3 - 5 years owning automation architecture for enterprise web applications.
- Deep, hands-on Playwright and Selenium expertise; strong C#/. NET or TypeScript; API testing across REST and SOAP.
- Practical LLM/AI tooling experience : prompt and agent design, AI-assisted test generation, evaluation/judging patterns, and a clear point of view on where AI output needs human review.
- CI/CD fluency (GitHub Actions preferred), SQL for data validation, and working knowledge of AWS.
- Evidence of designing QA processes and metrics from scratch, not just inheriting them; strong client-facing communication.
- AWS Bedrock/OpenRouter or equivalent LLM-platform experience; performance testing awareness (JMeter); test data management and synthetic data generation; energy/utilities domain exposure; experience on managed services or testing-CoE engagements with SLAs.
Skills
TypeScript, C#, Selenium, Automation Testing, Generative AI, Playwright Testing, Test Architect, Test Strategy, API Testing