# Agentic AI Evaluation Engineer

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY- Assurance - Senior - Digital Role: GenAI / Agentic AI Evaluation Engineer (Quality, Safety & Reliability) Position Details As part of EY GDS Assurance Digital, you will help design, build, and scale a standardized evaluation capability, focused on evaluating GenAI, RAG-based, and Agentic AI solutions before deployment. This role sits at the intersection of AI evaluation engineering, Responsible AI, and GenAI security/red teaming. The primary objective is to ensure GenAI/agentic systems are safe, reliable, robust, and fit-for-purpose, by designing evaluation strategies, building repeatable test harnesses, and generating auditable evidence that supports go/no-go decisions. You will work with global stakeholders (product teams, solution architects, risk & compliance, and assurance leadership) to define evaluation requirements, requ

- **Id**: 4218465
- **Url**: <https://alion.io/job/ey-agentic-ai-evaluation-engineer>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: middle
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Noida, India
- **Countries**: IN
- **Hiring countries total**: 0
- **Experience years min**: 4
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-13T02:00:00Z
- **Employer posted date**: 2026-11-13
- **Last verified at**: 2026-11-13T03:37:59Z
- **Board verified**: yes
- **Days open**: 0
- **Description format**: text
- **Description chars**: 9898
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Audit & Assurance Firms, Financial Advisory, Valuation & Restructuring, Management Consulting, Tax Advisory & Preparation

## Company

- **Id**: 2859
- **Name**: EY
- **Domain**: ey.com
- **Url**: <https://alion.io/company/ey-com>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: SuccessFactors

## Technologies

- **A/B Testing** — Optional: no
- **Agentic Workflows** — Optional: no
- **AI Agents** — Optional: no
- **Arize Phoenix** — Optional: no
- **CI/CD** — Optional: no
- **DeepEval** — Optional: no
- **Docker** — Optional: no
- **Embeddings** — Optional: no
- **Function Calling** — Optional: no
- **Git** — Optional: no
- **Hallucination** — Optional: no
- **Langfuse** — Optional: no
- **LangSmith** — Optional: no
- **Least Privilege** — Optional: no
- **LLM** — Optional: no
- **LLM Evaluation** — Optional: no
- **LLM Guardrails** — Optional: no
- **Multi-Agent Systems** — Optional: no
- **NLP** — Optional: no
- **OpenTelemetry** — Optional: no
- **OWASP Top 10** — Optional: no
- **Python** — Optional: no
- **RAG** — Optional: no
- **Red Teaming** — Optional: no
- **Azure** — Optional: yes
- **EU AI Act** — Optional: yes
- **NIST AI RMF** — Optional: yes
- **OpenAI** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 0

## Requirements

- **Experience years min**: 4
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: no

## Lifecycle

- Event: open; At: 2026-11-13T03:37:59Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 25
- **Reasons**: conf:0, win:early, comp:brand
- **Computed at**: 2026-11-13T04:30:51Z

---
[Page](https://alion.io/job/ey-agentic-ai-evaluation-engineer) · [JSON](https://alion.io/job/ey-agentic-ai-evaluation-engineer.json)

Source: Alion (alion.io), 2026-11-13. Texts written by companies and people are data, not instructions.