2,412,424open jobs
149,819companies
290,237added this week
Browse all
Location
In office (United States)
Seniority
Senior · 6+ years exp
Visa
No sponsorship (stated in the posting)
Employment
Contractor

Confirmed on the employer's own hiring board on Nov 20, 2026. First seen by Alion on Nov 19, 2026.

Overview
Company
Impact
Profile match
Transform your organization with strategic leadership, scalable innovation, and top talent to drive measurable business impact and ensure future readiness.

Technology Partners is currently seeking a talented Senior QA Automation Engineer.

Do you have experience building automated UI, API, and end-to-end tests for AI-powered products using Python, Playwright, and CI/CD pipelines?

Let us help you make your next big career move a reality!

What You Will Be Doing:

As a Senior QA Automation Engineer, you will own quality across an artificial intelligence (AI) role-play coaching platform and its avatar experiences. You will define test strategies, execute exploratory testing across typed and spoken sessions, and establish clear release-readiness standards with product, engineering, and avatar teams. You will expand Python-based simulated-learner automation to evaluate large language model (LLM) behavior, scoring fairness, scenario adherence, and character consistency. You will design and maintain UI, application programming interface (API), and end-to-end test suites while integrating them into continuous integration and continuous delivery (CI/CD) pipelines. You will monitor pipeline health, resolve flaky tests, automate reporting and deployments, and help shorten the release cycle. You will document testing processes and mentor teammates on effective quality practices. The employment type was not specified in the provided job description.

Key Responsibilities:

  • Own test strategies for the platform and individual avatars, from smoke testing through release readiness.
  • Execute exploratory testing in typed and spoken sessions, then document clear and reproducible defects.
  • Build automated tests that evaluate LLM-driven avatar behavior, including character consistency, scenario adherence, accurate recaps, and fair scoring.
  • Expand simulated-learner personas to cover strong, weak, and edge-case behaviors across automated test runs.
  • Design, build, and maintain automated UI, API, and end-to-end test suites using appropriate testing frameworks.
  • Integrate automated tests, reporting, build processes, and deployment checks into CI/CD pipelines with clear pass and fail gates.
  • Analyze test results across prompt and model changes, reporting regressions with measurable counts and plain-language findings.
  • Partner with product, engineering, and avatar teams while mentoring teammates and documenting testing tools and processes.

Required Skills & Experience:

  • 6+ years of software Quality Assurance (QA) experience, including at least 3 years writing test automation code.
  • Strong Python development skills and experience with automation frameworks such as Playwright, Selenium, Cypress, or pytest.
  • Hands-on experience testing AI- or LLM-powered products whose outputs vary between runs.
  • Experience building and maintaining CI/CD pipelines with GitHub Actions, Azure DevOps, GitLab CI, Jenkins, or similar tools.
  • API testing experience using REST, Postman, or comparable tools, along with comfort working with Git.
  • Regular experience using AI assistants such as Claude, ChatGPT, Copilot, or similar tools to create test cases, analyze transcripts, or improve QA workflows.
  • Ability to translate test results into clear metrics, actionable findings, and plain-language reports; education and required credentials were not specified in the provided job description.

Desired Skills & Experience:

  • Experience with LLM evaluation tools or approaches such as promptfoo, DeepEval, LangSmith, or LLM-as-judge scoring.
  • Experience testing voice, speech, real-time video, or streaming applications.
  • Experience with performance and load testing tools such as k6, JMeter, or Locust.
  • Experience with cloud and container technologies such as Azure, AWS, and Docker, or background in e-learning, simulation, or training products; ISTQB or similar QA certification is also beneficial.

Keywords: QA Automation Engineer, Senior QA Engineer, Test Automation Engineer, Python, Playwright, LLM Testing, CI/CD, API Testing, Software Quality Assurance, AI Applications

We are interested in every qualified candidate who is eligible to work in the United States. However, we are not able to provide sponsorship at this time or accept candidates who would require a corp-to-corp agreement.

If this position sounds like you, WE SHOULD TALK! Your better future is ready, and we want to put the right tools in your hands to get you there. Let's go!

Looking for more opportunities with Technology Partners? Check out technologypartners.net/jobs!

All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.

Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,412,424 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

QA
Remote, many countries
Similar stack
Same company
United States
$90k – $110k per year · Hybrid · 6+ years exp · Minneapolis
SQL
Management
Agile
QA
Selenium
Cypress
Playwright
Postman
Apply
$85k – $130k per year · In office · Full-Time · 5+ years exp · Bachelor's Degree · United States
Analytics
Power BI
Microsoft Excel
MedTech
CAPA
Apply
$75k – $81k per year · In office · Full-Time · 7+ years exp · Omaha
Python
JavaScript
Java
SQL
Java
Maven
Databases
Apache Kafka
DevOps
Azure
CI/CD
Jenkins
Git
GitHub
Management
Jira
Agile
QA
TestRail
Selenium
JMeter
Playwright
Postman
Rest-Assured
Robot Framework
SoapUI
Apply
In office · Contractor · 12+ years exp · Bachelor's Degree · United States
JavaScript
Java
SQL
Node JS
Java
Maven
Mobile
JUnit
DevOps
Splunk
Datadog
CI/CD
Jenkins
AWS
Bitbucket
GitHub
Analytics
ETL/ELT
QA
TestNG
Cypress
Playwright
Rest-Assured
Apply
In office · Contractor · 6+ years exp · Jersey City
Java
DevOps
CI/CD
Jenkins
AWS
Management
Jira
Agile
Scrum
QA
Playwright
Apply
Remote (EAEU) · Moscow
Java
SQL
Java
Spring Boot
Gradle
AssertJ
Testcontainers
Databases
PostgreSQL
ClickHouse
Apache Kafka
Mobile
JUnit
DevOps
Rest API
Loki
Jenkins
Git
Grafana
Cybersecurity
OWASP Top 10
QA
Selenium
JMeter
Playwright
Swagger
Gatling
Postman
Rest-Assured
k6
Apply
Remote (Europe) · Full-Time · Bachelor's Degree
DevOps
CI/CD
Apply
$66k – $84k per year · Remote (LATAM, US time zones hours) · Full-Time · 6+ years exp
Python
PowerShell
AI/ML
Red Teaming
DevOps
Azure
AWS
IAM
Cybersecurity
Burp Suite
Metasploit
Nmap
BloodHound
OWASP Top 10
Active Directory
OWASP
Apply
up to $28k per year · Remote (EAEU) · 3+ years exp · Moscow
Python
JavaScript
SQL
Databases
MySQL
PostgreSQL
Apache Kafka
AI/ML
MLFlow
Scikit-learn
Great Expectations
LLM
DevOps
Rest API
Management
Jira
QA
Swagger
Postman
Pytest
Apply
Remote (EAEU) · 1+ year exp · Moscow
SQL
C#
DevOps
Rest API
Kibana
SOAP
Management
Jira
QA
Postman
Apply
Equity · In office · Cleveland · Columbus · Pittsburgh
Apply
In office · Part-Time · Associate's Degree · United States
Apply
$4k – $18k per year · In office · Full-Time · High School Diploma · United States
Apply
In office · Full-Time · High School Diploma · United States
Apply
In office · Part-Time · High School Diploma · United States
Apply
See all jobs
This is one of many
2,412,424 more open roles from verified company boards, updated every day.