2,406,540open jobs
149,823companies
297,031added this week
Browse all
Salary
$64k – $72k per year
Location
In office (Warsaw)
Employment
Contractor

First seen by Alion on Nov 19, 2026.

Overview
Company
Impact
Profile match
Darize is your Tech Transformation Partner, combining expertise in AI, data and security to turn ambition into measurable outcomes.

We are looking for a Senior Automation QA Engineer who will focus on end-to-end quality of the multi-tenant, serverless AWS platform where teams build, deploy and run AI agents. Each team gets an isolated workspace with browser-based dev environments (VS Code, Langflow, n8n), automated agent deployment, an agent marketplace and real-time logs. The ideal candidate will have a strong background in software quality assurance and test automation, with a proven track record of defining test strategies and building and owning API and UI test automation for web platforms, as well as a practical understanding of how AI agents behave. You will play an important role in ensuring the performance, reliability, and accuracy of our intelligent systems.


Frontend: React / TypeScript single-page application

Backend / API: Go Lambda functions behind AWS API Gateway (OpenAPI-documented REST), WebSocket log streaming, Python CLI

Agents: AWS Bedrock AgentCore; templates for multiple frameworks (e.g., LangGraph, AWS Strands); MCP and A2A


100% remote work.

Zakres obowiązków

  • Test Strategy: Define the test strategy and test pyramid with developers and platform engineers, and keep it up to date as the platform grows.
  • Test Repository Ownership: Set up and own the automation repository: structure, conventions, shared fixtures, code review and reporting. Keep it simple enough that developers can add tests themselves.
  • API Test Automation: Build functional, schema, negative and regression suites for the REST API. Cover long-running asynchronous flows: agent deployments, image builds, provisioning of dev environments and WebSocket log streaming.
  • UI Test Automation: Build a stable Playwright E2E suite for the critical user journeys: workspaces, agent deployment, marketplace, evaluation, monitoring and admin.
  • Agent Integration & Smoke Testing: Deploy the supported agent templates through the platform. Check that endpoints respond, auth is enforced, logs and traces arrive, MCP tool calls succeed and memory persists.
  • CI/CD & Test Environments: Run the suites in CI as merge-request gates, nightly regression runs and post-deploy smoke tests. Automate the setup and cleanup of short-lived test workspaces and test data in AWS.
  • Collaboration and Troubleshooting: Work closely with developers, AI engineers, and platform teams to identify automation opportunities and improve overall software quality. Conduct root cause analysis for identified issues and collaborate with development teams for resolution.

Wymagania

Requirements
  • Test Strategy & Repository Ownership: 5+ years in software quality engineering. You have defined a test strategy for a web platform or SaaS product. You have also set up and owned a test automation repository (not only contributed tests to one), including its structure, conventions, CI integration, code reviews and long-term maintenance, in Python or TypeScript.
  • API Test Automation: Strong hands-on experience automating REST API tests (e.g., pytest + httpx, Playwright API testing), including: schema validation against OpenAPI (contract testing is a plus) asynchronous flows (polling, state machines, queues, WebSockets) auth and access control (OAuth2/OIDC, JWT, role- and tenant-based access, negative cases)
  • UI Automation: Proven experience with Playwright on React/SPA applications. You have kept a large suite stable and kept flaky tests measured and under control.
  • CI/CD & Cloud: Experience building quality gates in GitLab CI (or a similar tool) with Docker. Experience testing cloud-hosted applications and debugging through logs, metrics and traces.
  • AI Awareness & Daily Use: You understand how LLM-based agents behave (tools, memory, non-determinism). You use AI assistants (e.g., Claude Code, GitHub Copilot) every day in your own work: writing tests, analysing failures and documenting. You review AI-generated code critically.
  • Communication: Strong collaboration and reporting skills; ability to work in cross-functional and international teams. Strong analytical and problem-solving skills with attention to detail.
  • Nice to have: AWS experience (Lambda, API Gateway, DynamoDB, S3, CloudWatch, Bedrock AgentCore). Experience with Strands or other agent frameworks (e.g., LangGraph, CrewAI). Familiarity with LLM evaluation tools (e.g., DeepEval, Promptfoo, Ragas). Experience with MCP / A2A servers and protocols. Knowledge of vector-based retrieval systems. Experience in monitoring & observability. Experience with full-stack application testing. Security testing: working knowledge of the OWASP Top 10 (web and API) and hands-on penetration testing experience (e.g., Burp Suite, OWASP ZAP) Knowledge of GxP or regulated environments is a plus. Strong analytical mindset and attention to detail.

Tech stack

  • Test strategy
  • Test automation
  • Python
  • TypeScript
  • API
  • REST API
  • pytest
  • Playwright
  • API testing
  • JWT
  • UI
  • React
  • CI/CD
  • GitLab CI
  • Docker
  • Testing
  • AI
  • Claude
  • GitHub
  • OpenAPI
  • AWS
  • AWS Lambda
  • API Gateway
  • AWS DynamoDB
  • AWS S3
  • CloudWatch
  • LLM
  • Protocols
  • Security
  • OWASP
  • Burp Suite
  • GXP
Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,406,540 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

QA
Similar stack
Same company
Warsaw
$60k – $74k per year · Hybrid · Poznań
Java
SQL
Java
Maven
Gradle
DevOps
Rest API
CI/CD
Jenkins
Git
Gerrit
GitLab
SOAP
Management
Confluence
Jira
QA
Appium
Postman
Apply
$39k – $59k per year · Hybrid · Poznań
Java
SQL
Java
Maven
Gradle
DevOps
Rest API
CI/CD
Jenkins
Git
Gerrit
GitLab
SOAP
Management
Confluence
Jira
QA
Appium
Postman
Apply
In office · Full-Time · 4+ years exp · Katowice
QA
Charles Proxy
Apply
Hybrid · 5+ years exp · Kraków
Java
SQL
Java
Spring Boot
Testcontainers
Databases
MySQL
MS SQL
AI/ML
Cursor
Claude
Mobile
JUnit
DevOps
Rest API
GitHub Actions
CI/CD
Docker
Kubernetes
Cybersecurity
SonarQube
Shift-Left Security
QA
TestNG
JMeter
Gatling
Rest-Assured
k6
Apply
QA Engineer 11 hours ago
Hybrid · 3+ years exp · Katowice
JavaScript
TypeScript
DevOps
Rest API
Azure DevOps
Azure
CI/CD
Management
Confluence
Jira
Agile
QA
Selenium
Playwright
Postman
Insomnia
Rest-Assured
Apply
In office · 8+ years exp · Bachelor's Degree · Warsaw
JavaScript
TypeScript
AI/ML
Gemini
Machine Learning
Frontend
Angular
React.js
Apply
Penetration Tester 6 hours ago
Hybrid · Full-Time · 2+ years exp · Bachelor's Degree · Warsaw
Python
JavaScript
PowerShell
C#
Bash
AI/ML
Function Calling
AI Agents
LLM
RAG
DevOps
GCP
Azure
AWS
IAM
Linux
Windows
Cybersecurity
Burp Suite
Metasploit
Nmap
BloodHound
Ghidra
Frida
Apply
$57k – $106k per year (gross) · Hybrid · Full-Time · 5+ years exp · Bachelor's Degree · Warsaw
Python
SQL
Databases
Snowflake
AI/ML
Claude
Prompt Engineering
AI Agents
NLP
LLM
OpenAI Agents SDK
Agentic Workflows
Machine Learning
DevOps
Azure
Git
AWS
Analytics
Tableau
Management
Confluence
Jira
Agile
MedTech
ISO 13485
21 CFR Part 820
Apply
Hybrid · 5+ years exp · Warsaw
AI/ML
Copilot
Apply
In office · Warsaw
Apply
See all jobs
This is one of many
2,406,540 more open roles from verified company boards, updated every day.