Generative AI Engineer - AI/QA
First seen by Alion on Aug 19, 2026.
The Opportunity :
Were looking for a GenAI Expert who can build AI systemsand break them before production does.
This is a high-impact IC role at the intersection of Generative AI, AI Engineering and Quality Engineering.
Youll own the complete lifecycle : architect - build - test - deploy - measure - improve.
If youre equally comfortable designing a RAG pipeline and designing the test strategy that proves it works, this role is for you.
What Youll Own :
- Build and ship production-grade LLM/RAG applications and AI agents.
- Design AI testing and evaluation strategies for accuracy, reliability, hallucinations, bias and non-deterministic outputs.
- Develop test automation across unit, integration, E2E, regression and performance.
- Optimize models, prompts, retrieval, inference, latency and cost.
- Establish AI quality gates, CI/CD automation, telemetry and production monitoring.
- Experiment, measure and continuously improve AI performance.
- Mentor engineers and drive GenAI engineering & quality best practices.
What You Bring :
- 8+ years overall experience, combining strong GenAI and QA/Test Automation expertise.
- 4+ years hands-on experience building/shipping GenAI/LLM solutions.
- 5+ years strong experience in QA, testing and automation.
- Hands-on expertise with RAG, LLM APIs, vector databases, prompt engineering and model evaluation.
- Experience with OpenAI / Anthropic / Hugging Face, Pinecone / Weaviate / FAISS.
- Strong automation experience with PyTest, Jest, Selenium, Cypress or similar.
- Experience with LLM evaluation, hallucination testing, model regression, bias testing and A/B testing.
- Strong understanding of accuracy vs. latency vs. cost trade-offs.
- A builder mindset with strong ownership and the ability to operate independently.
Why This Role? :
This isn't traditional QA.
This isn't just GenAI experimentation.
Youll build AI systemsand engineer the quality layer that makes them production-ready.
If youre excited about AI + Automation + Quality at scale, we want to hear from you.
Skills
Generative AI, LLM, RAG, Artificial Intelligence, Machine Learning, VectorDB, Prompt Engineering, OpenAI