QA Engineer
First seen by Alion on Oct 16, 2026.
QA Engineer
Role Overview
Job Type: Contract
Work Arrangement: Remote
Compensation: $120,960-$230,400 per year (annualized equivalent)
Hourly Rate: $63-$120
About the Role
We are seeking detail-oriented QA Engineers to support the testing and evaluation of AI systems. You will apply software quality assurance expertise to validate AI outputs, assess data quality, identify defects, and provide structured feedback to improve model performance.
The role combines test case design, test execution, defect reporting, data annotation, and AI model evaluation. It is suited to professionals who can assess results systematically, document findings accurately, and communicate quality issues clearly.
Prior AI experience is not required. Experience in software testing and quality assurance is the primary focus, while data annotation or model evaluation experience is an advantage.
Key Responsibilities
Design, execute, and document test cases and scenarios to evaluate AI outputs against defined requirements.
Review, annotate, and label datasets to support accurate machine learning model training.
Evaluate model predictions and identify inconsistencies, defects, errors, and recurring patterns.
Document test results, evaluation findings, and feedback in clear, organized records.
Collaborate with cross-functional teams to clarify requirements, communicate findings, and resolve questions.
Contribute to the development and refinement of testing methodologies for AI-driven systems.
Recommend improvements to data quality, testing processes, and model performance.
Required Qualifications
Hands-on experience in software quality assurance and testing.
Understanding of test planning, test case design, test execution, and defect reporting.
Strong attention to detail when reviewing outputs, datasets, and test results.
Ability to analyze findings, identify inconsistencies, and provide actionable feedback.
Proficiency in English at B2 level or above.
Strong written communication and documentation skills.
Ability to collaborate effectively with cross-functional teams.
Preferred Qualifications
Experience with data labeling, data annotation, or dataset quality review.
Familiarity with AI model evaluation or reinforcement learning from human feedback (RLHF).
Experience evaluating system outputs against defined quality standards.
Ability to identify patterns in test results and recommend improvements to testing methodologies.
Key Skills
Software quality assurance, test case design, test execution, test planning, defect reporting, data annotation, data labeling, AI model evaluation, dataset validation, quality control, documentation, analytical reasoning, English communication, and cross-functional collaboration.
Compensation
The hourly rate is $63-$120, equivalent to approximately $120,960-$230,400 per year at 1,920 working hours annually. This annualized figure is for comparison only; actual earnings depend on contracted hours and workload.
What to Expect
You will perform structured testing, review datasets, evaluate AI-generated outputs, document defects, and recommend improvements. The work emphasizes systematic quality assurance, data integrity, accurate reporting, and clear communication. Previous AI experience is not required.