Product Analyst
First seen by Alion on Sep 9, 2026. INSPYR Solutions scores B on the Alion truth index.
Location: Austin, TX
ABOUT THIS FEATURED OPPORTUNITY
The Product Analyst will join the Channel Strategy & Operations team to support the development of a portfolio of strategic AI agents and an enterprise agent marketplace/platform. You own the evaluation, testing, measurement, and quality component of the products being built.
THE OPPORTUNITY FOR YOU
- Develop and execute evaluations to measure the accuracy, quality, reliability, and overall performance of AI agents and agentic workflows.
- Create test cases, evaluation criteria, guardrails, and measurement frameworks to validate agent outputs against expected outcomes.
- Analyze evaluation and testing results, identify failure patterns and edge cases, and translate findings into actionable product and engineering recommendations.
- Use Claude or similar agentic AI/coding tools to automate testing and evaluation workflows, analyze results, and improve the efficiency of quality processes.
- Partner closely with Product and Engineering teams throughout development to validate requirements, test new functionality, troubleshoot issues, and improve agent performance.
- Develop reporting and analytics that provide visibility into product quality, performance trends, and opportunities for improvement.
KEY SUCCESS FACTORS
- 2-5 years of experience in Testing, Measurement, Evaluation or Quality Assurance
- Experience designing and executing evaluations to measure accuracy, quality, reliability, or performance
- Experience developing test cases or evaluation frameworks, analyzing results, identifying failure patterns, and validating outputs
- Strong analytical and problem-solving skills with the ability to translate data and testing results into actionable insights
- Hands-on experience with Claude or other agentic AI/coding tools, including using AI to automate workflows, testing, analysis, or other tasks
- Strong cross-functional collaboration skills with experience partnering with Product, Engineering, Data/AI, and business stakeholders
NICE TO HAVES
- Understanding of sales organizations, sales processes, market expansion, or sales operations
- Experience working within a large, highly matrixed organization
- Portfolio or examples of AI products, prototypes, workflows, or applications personally developed or helped bring to market
About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, or any other protected status. INSPYR Solutions complies with all applicable laws governing nondiscrimination in employment in every location in which the company has facilities. Applicants requiring reasonable accommodation during the application or interview process should contact [email protected] for assistance.
Information collected and processed through your application with INSPYR Solutions (including any job applications you choose to submit) is subject to INSPYR Solutions' Privacy Policy and INSPYR Solutions' AI and Automated Employment Decision Tool Policy: https://www.inspyrsolutions.com/policies/. By submitting an application, you are consenting to being contacted by INSPYR Solutions through phone, email, or text.
26-159279