Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 20, 2026. Luxoft scores A on the Alion truth index.
Project description
Join our Development Center in Bucharest, and become a member of our open-minded, progressive and professional team. In this role you will be working on projects for one our world-famous clients.
You will have a chance to grow your technical and soft skills and build a thorough expertise of the industry of our client. On top of attractive salary and benefits package, Luxoft will invest into your professional training, and allow you to grow your professional career.
We are looking for a highly motivated an AI Quality Assurance Manual Engineer to ensure the quality, reliability, and performance of our AI-powered solutions built on Google’s Gemini platform and CX Agent Studio automation systems. You’ll play a critical role in manually testing and validating conversational AI experiences, probabilistic system behaviors, and customer experience automation workflows.
Responsibilities
- Design and execute detailed manual testing strategies for Gemini-powered applications and CX Agent Studio automation workflows, focusing on conversational AI quality, intent recognition accuracy, and end-to-end customer journey validation.
Track use case processing through the entire technical stack, utilizing GCP Logs Explorer, BigQuery, and PostgreSQL to isolate issues.
Raise well-documented defects, with the ability to locate approximately where the issue is originating in the technical stack.
Monitor deployed conversational AI agents for response quality degradation, hallucinations, and edge-case failures, while evaluating prompt engineering effectiveness and model response consistency.
Validate non-deterministic system behaviors, natural language understanding accuracy, entity extraction, and sentiment analysis within CX Agent Studio workflows.
Conduct adversarial testing to identify prompt injection vulnerabilities, analyze conversational outputs for bias or inappropriate content, and collaborate with product teams to define acceptance criteria.
Follow strictly defined QA methodologies and processes throughout the software development lifecycle.
Take complete ownership of what is deployed to production.
Thrive in a fast-paced environment with weekly release cadences, taking ownership of functional testing, regression testing, smoke testing and ongoing test suite maintenance to ensure high-quality deployments.
SKILLS
Must have
- Experience: 1+ years of experience in manual software quality assurance, with exposure to testing AI/ML systems, conversational AI, or customer experience platforms.
Strong understanding of testing probabilistic systems, large language models, prompt engineering, and dialogue flow validation.
Technical Stack:
o Experience with Google Cloud Platform (GCP) focusing on Logs Explorer, BigQuery, and PostgreSQL.
o Experience with API testing tools such as Postman or Bruno.
o QA Standards: Strong knowledge of standard QA methodologies, tools, and processes, with a commitment to following them strictly.
o CI/CD: Experience with version control and CI/CD tools like GitHub Actions.
o Excellent communication skills, working closely with AI developers and CX designers in an Agile/Scrum environment.
o Appropriate usage of JIRA and Confluence
Nice to have
German language is a plus

