{"id":2587795,"url":"https://alion.io/job/testpros-senior-ai-test-engineer-remote-testpros","title":"Senior AI Test Engineer (Remote) - TestPros","company":{"id":450083,"name":"TestPros","domain":"testpros.com","url":"https://alion.io/company/testpros","size_band":null,"is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"JazzHR","truth_index":null},"role":"QA","role_family":"QA","seniority":"senior","employment_type":null,"work_mode":"remote","remote_scope":"stated_countries","remote_scope_basis":"inferred_payroll_markers","remote_working_hours":null,"hiring_geo_confidence":"inferred","locations":[],"countries":[],"hiring_countries":["US"],"hiring_countries_total":1,"salary":{"min":50,"max":80,"currency":"USD","period":"hour","gross":null,"usd_annual":160000},"salary_estimate":null,"experience_years_min":10,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"AI Agents","optional":false},{"name":"AutoGen","optional":false},{"name":"AWS","optional":false},{"name":"Azure","optional":false},{"name":"CI/CD","optional":false},{"name":"CrewAI","optional":false},{"name":"Cursor","optional":false},{"name":"Cypress","optional":false},{"name":"GCP","optional":false},{"name":"GitHub","optional":false},{"name":"Hallucination","optional":false},{"name":"LangChain","optional":false},{"name":"LLM","optional":false},{"name":"Machine Learning","optional":false},{"name":"NIST AI RMF","optional":false},{"name":"NLTK","optional":false},{"name":"OWASP","optional":false},{"name":"Playwright","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"Selenium","optional":false},{"name":"Self-Healing","optional":false}],"status":"live","first_seen_at":"2026-10-15T04:37:30Z","employer_posted_date":"2026-10-15","last_verified_at":"2026-10-15T09:46:44Z","board_verified":true,"closed_at":null,"days_open":0,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":0},"description":"TestPros delivers innovative independent IT assessment solutions to critical challenges facing the nation and the world. We support the U.S. Federal/State/Local Government and Commercial clients within the continental USA. TestPros is dedicated to making lives better, safer and more secure.\nTestPros is seeking a Senior Artificial Intelligence (AI) System Test Engineer with an analytical, customer-focused mindset and experience with the OWASP AI Testing Guide and other guidelines from NIST, ISO, and IEEE.\nStart: Future projects in late 2026 or 2027 (not an immediate job opening)\nType: Part-time consulting\nOverview\nFocus: Software test end evaluation\nRegulatory Basis: OWASP AI Testing Guide, NIST AI Risk Management Framework (AI RMF), NIST Cybersecurity Framework (CSF) Cyber AI Profile, AI Bills of Materials (AI-BOMs), NSA AI Security Guidelines.\nLocation: Remote, with occasional travel to customer sites or TestPros labs in Sterling, VA\nThis role evaluates AI systems and software for alignment with the intended functions and features, plus additional assessment focused on AI-specific validation, including model robustness, data integrity, adversarial defense, performance, usability, reliability, security, maintainability, safety, and other aspects of overall quality.\n.\nKey Responsibilities:\nDevelop and execute test plans and evaluate software for compliance with the OWASP AI Testing Guide and other guidance, create defect and remediation records, capture test evidence and document defects with clear reproduction steps and severity ratings, report results to senior management and stakeholders.\nRequired Skills.\nBachelor's degree in computer science, engineering or a related field.\n10+ years of experience in Software/System Testing and Quality Engineering (QE), including enterprise-scale transformation programs.\nSolid understanding of and experience with the OWASP AI Testing Guide, and the NIST AI Risk Management Framework (RMF).\n4+ years hands-on experience defining the testing strategy for large scale programs and ensuring requirements traceability throughout the system development lifecycle. Experience should include leading the testing efforts, including experience with all phases of testing: system integration, user acceptance, and performance testing.\nA deep understanding of testing planning and associated delivery challenges.\nA strong understanding of the various approaches used in testing techniques - white-box, black-box, load testing, coverage testing and regression testing.\nProven experience in defining and executing QE transformation strategy.\nHands-on expertise in Agentic AI / GenAI frameworks (e.g., LangChain, AutoGen, CrewAI, Cursor, etc.).\nExperience working in Cloud, Web and Mobile Testing platforms - Saucelabs, Browerstack are preferred.\nHands-on experience with machine learning models.\nExperience in Python NLTK or similar natural language processing technology.\nPractical experience implementing AI-driven QE solutions such as:\nAutonomous test generation\nSelf-healing automation\nDefect prediction and intelligent triaging\nExpertise in test automation tools (Selenium, Playwright, Cypress, etc.).\nStrong experience with CI/CD pipelines and DevOps integration (GitHub).\nSolid understanding of API, microservices, and cloud-native architectures.\nExperience evaluating or testing Artificial Intelligence (AI) Large Language Model (LLM)-based application features (e.g., chatbots, copilots, RAG-based systems), including prompt-response validation and hallucination/edge-case testing.\nExposure to AI-assisted defect triage or root-cause analysis tools that reduce manual investigation time.\nExperience with cloud platforms (AWS, Azure, GCP) in QE/AI context.\nExposure to self-healing test automation frameworks (AI-driven locator repair, visual AI testing).\nUnderstanding of responsible AI/testing governance principles (bias detection, explainability, model validation) as applied to QE.\nExperience contributing to or influencing AI-adoption roadmaps within a testing/QE organization.\nExperience implementing testing best practices specific to the test planning and execution processes and gaining buy-in for changes from executives.\nPreferred SkillsExperience with test automation tools, and AI assisted test tools\nFamiliarity with JIRA project/test management system\nKnowledge of other IT compliance such as WCAG/Accessibility, IT Security, IT Privacy\nProfessional certifications in the software testing discipline\nWork Environment: Hands-on testing role. Remote-friendly with occasional on-site or hybrid work as needed.\nRate: $50-80/hr. 1099 or Corp. To Corp.). This range represents a good-faith estimate and is not a guarantee; final compensation is determined by factors such as experience, qualifications, and government contract labor rate requirements and may fall outside the stated range.\nEqual Opportunity Employer\nTestPros is an equal-opportunity employer and does not discriminate in employment based on race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or any other non-merit factor.\nOffer Considerations\nTestPros considers several factors when extending an offer, including but not limited to, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, geographic location, education, and certifications.\nFederal Compliance\nAs a federal contractor, TestPros is subject to all federal and state mandates and/or other customer requirements.","description_format":"text","description_chars":5716,"description_truncated":false,"requirements":{"experience_years_min":10,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"bachelor","optional":false},"security_clearance":false,"languages":[]},"benefits":["Hybrid work"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["Software Testing & QA"],"lifecycle":[{"event":"open","at":"2026-10-15T04:37:30Z"}],"visa":[],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":0,"expected_fill_days":29,"reasons":["conf:1","win:early"],"computed_at":"2026-10-15T05:46:00Z"},"pay":{"stated_usd_annual":160000,"is_top_pay":true},"html_url":"https://alion.io/job/testpros-senior-ai-test-engineer-remote-testpros","json_url":"https://alion.io/job/testpros-senior-ai-test-engineer-remote-testpros.json","meta":{"generated_at":"2026-10-15T11:07:57Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":17087,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-10-16T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.02,"usd":0.002,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":450083},"rest":"https://alion.io/mcp/rest/get_company?id=450083"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Ftestpros-senior-ai-test-engineer-remote-testpros"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"live","price":{"credits":1,"usd":0.1},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Ftestpros-senior-ai-test-engineer-remote-testpros"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.02,"usd":0.002},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Ftestpros-senior-ai-test-engineer-remote-testpros"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/testpros-senior-ai-test-engineer-remote-testpros\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Ftestpros-senior-ai-test-engineer-remote-testpros"}]}