Middle Automation QA Engineer with AI
Svitla Systems Inc. is looking for a Middle Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland. Our client is a British wholesale distributor.
This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for an experienced AQA professional who will be responsible for testing the outputs of an AI-based system. The ideal candidate will define and build the QA strategy from the ground up, establishing test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors.
Hybrid mode with 2-3 days per week working from the office in Kraków.
Requirements:
3+ years of commercial experience as a Quality Assurance Engineer, including both manual and automation testing.
Strong hands-on experience with Node.js and TypeScript for test automation.
Proven experience with Playwright for end-to-end test automation.
Experience testing APIs, backend services, and modern web applications.
Ability to build and improve test automation frameworks, QA processes, and testing strategy.
Experience testing AI-powered or non-deterministic systems, or a strong interest in working with AI-driven products.
Familiarity with LLMs and AI-assisted development/testing tools.
Strong analytical, problem-solving, and communication skills, with the ability to thrive in fast-paced, ambiguous environments.
Nice to have:
Experience with Java.
Experience with REST Assured/REST API testing.
Responsibilities:
Develop and continuously enhance robust, scalable test automation frameworks using Node.js or TypeScript (Playwright).
Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product.
Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds.
Own the execution and management of both manual and automated test cases.
Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution.
Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality.
Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems.
We offer:
US and EU projects based on advanced technologies.
Competitive compensation based on skills and experience.
Regular performance appraisals to support your growth.
Flexibility in the workspace, either remote or in our welcoming office.
Comprehensive medical insurance after one month.
MultiSport card with access to 2500 sports facilities all over Poland
Bonuses for recommendations of new employees.
Bonuses for article writing, public talks, and other activities.
15 vacation days, 10 national holidays, 10 sick leaves, and family days off.
Personalized learning program tailored to your interests and skill development.
Free tech webinars and meetups organized by Svitla.
Welcome and anniversary presents, gifts for children, and more.
Regular corporate events and meetups.
Awesome team, friendly and supportive community!
Ref #5089