Overview
Company
Profile match
Impact
Conditions
Benefits
Hiring process
Similar jobs
Billennium is an international IT services and software development company specializing in cloud solutions, enterprise application development, and digital transformation. Headquartered in Poland with global delivery centers, the company provides end-to-end technology services, managed IT, and staff augmentation to enterprise clients worldwide. By partnering with leading cloud platforms like AWS, Microsoft, and Salesforce, Billennium helps organizations optimize their digital infrastructure and streamline business operations.

We are looking for a Senior QA Automation Engineer to help build and validate enterprise-scale GenAI products. The ideal candidate combines strong automation skills with experience in API, database and ETL testing and understands how to validate AI-powered applications in regulated environments.

What you will do:

  • Design and develop automated testing solutions for GenAI products

  • Build and maintain scalable test frameworks using Python and Playwright

  • Design, implement and execute WebUI and API test automation

  • Create validation strategies for AI-powered applications and GenAI workflows

  • Validate AI-generated outputs, data quality and end-to-end business processes

  • Develop and execute automated testing for database integrations and ETL processes

  • Create SQL-based validation scenarios to ensure data consistency and integrity

  • Collaborate with engineering and product teams to improve quality, reliability and test coverage

  • Contribute to automation and quality engineering best practices across the software development lifecycle

What we are looking for:

  • 5+ years of experience in Test Automation Engineering, QA Automation or SDET roles

  • Strong proficiency in Python

  • Hands-on experience with Playwright

  • Experience with WebUI test automation

  • Experience with API testing and automation

  • Strong understanding of databases and database testing

  • Strong SQL skills

  • Experience validating ETL processes, data pipelines or complex data workflows

  • Extensive validation experience, preferably in regulated industries such as Pharma, Healthcare, Banking or Financial Services

  • Experience building automated testing solutions across UI, API and data layers

  • Understanding of AI-powered applications, GenAI products or AI-assisted testing approaches

  • Strong analytical and problem-solving skills

  • Experience testing LLM- or AI-based applications

  • Ability to collaborate effectively in cross-functional and international teams

Nice to have:

  • Experience with AWS and cloud-based testing environments

  • Experience with Apache Airflow

  • Neo4j

  • Postman

  • Cypher / OpenCypher

  • MCP (Model Context Protocol)

  • AWS Bedrock

  • Knowledge of data quality or machine learning validation practices

Perks and benefits:

  • Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.

  • Flexibility - adaptable working hours and remote/hybrid work options to suit your lifestyle & location.

  • Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.

  • Global collaboration - work with a diverse, international team.

  • Innovative environment - be part of a forward-thinking and growth-oriented workplace.

  • Engaging community - Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.

  • Team-building events including our company tradition (annual company event in Mazury).

  • A pleasant surprise to start your journey with us in the form of a welcome pack.

Sounds interesting? Click "Apply" and have a chance to hear more!

Recommended for you based on this role

Similar stack
Same company
In your city
Security Architect 9 days ago
In office • Full-Time • 5+ years exp • Warsaw
Databases
Snowflake
DevOps
AWS
Kubernetes
Cybersecurity
OWASP ASVS
OWASP Top 10
Threat Modeling
Marketing
Salesforce
Apply
.NET Developer 9 days ago
Remote • Full-Time • Warsaw
C#
Java
SQL
C#
.NET
Java
Hibernate
Liquibase
Spring Boot
Spring Cloud
Spring Data JPA
Databases
Apache Kafka
MS SQL
Mobile
JUnit
DevOps
Git
Rest API
Management
Confluence
Jira
Apply
Remote/Hybrid • Internship • Warsaw
Databases
Snowflake
DevOps
AWS
Marketing
Salesforce
Apply
Remote/Hybrid • Full-Time • 5+ years exp • Warsaw
Python
Databases
pgvector
PostgreSQL
Snowflake
AI/ML
NLP
RAG
DevOps
AWS
Marketing
Salesforce
Apply
Remote • Full-Time • Lublin
C#
SQL
C#
.NET
Databases
Snowflake
DevOps
AWS
Azure
Azure DevOps
CI/CD
Jenkins
Management
Confluence
Jira
Marketing
Salesforce
QA
JMeter
Playwright
Postman
Selenium
SoapUI
Apply
In office • Full-Time • 5+ years exp • Bachelor's Degree • Warsaw
Python
DevOps
Akamai
Ansible
AWS
Azure
Cloudflare
GCP
Terraform
Cybersecurity
Zero Trust
Zscaler
Apply
Remote/Hybrid • Full-Time • 5+ years exp • Warsaw
JavaScript
Databases
Snowflake
DevOps
AWS
CI/CD
Git
Management
Jira
Marketing
Salesforce
QA
Appium
Cypress
Gatling
JMeter
Postman
Rest-Assured
Selenium
TestNG
Apply
Remote/Hybrid • Full-Time • 5+ years exp • Warsaw
Databases
Snowflake
DevOps
AWS
Incident Management
Management
Jira
Marketing
Salesforce
Apply
Remote/Hybrid • Internship • 5+ years exp • Kraków
C#
C#
.NET
Databases
Snowflake
DevOps
AWS
Marketing
Salesforce
QA
Appium
Apply
Remote/Hybrid • Full-Time • Łódź
Databases
Snowflake
DevOps
AWS
Azure
CI/CD
GCP
Terraform
Marketing
Salesforce
Apply
Career impact
Discover how this job can transform your career
Get a personal career forecast for this job - salary uplift, next-level role, skill boost and a 3-year financial impact, all calculated from your profile.
Personal salary uplift vs. your current pay
Your 3-year career trajectory
Skills you will level up in this role
3-year financial impact in dollars
Create free account
Free forever • Less than a minute • No credit card

Work setup

Location
Warsaw
Remote work
Remote/Hybrid
Employment
Internship

Compensation

Benefits
Hybrid work, Professional development