# AI Evaluation Engineer (Testing oraz Development)

Why us? 🤝 We are part of the ALTEN Group – a leading European provider of engineering and technology consulting servics. Join ALTEN Polska and let’s grow together! 🌎Location: Kraków- hybird work (6 x month) 👉In this role, you will: We are seeking an AI Evaluation & Development Engineer who will play a key role in testing, evaluating, and improving AI agents and GenAI applications while contributing to the development of supporting services and integrations. Tasks associated with this role include: Design, build, and maintain evaluation frameworks for AI agents and Generative AI solutions. Define testing methodologies, benchmarks, and quality metrics for agent performance. Evaluate AI outputs for accuracy, relevance, consistency, safety, and adherence to business requirements. Identify and analyze hallucinations, failure cases, and context-related issues. Create automated testing pipelines and regression testing strategies for GenAI applications. Validate Retrieval Augmented Generation (RAG) systems, memory stores, and context-engineering mechanisms. Collaborate with AI Engineers, Data Engineers, and Product teams to improve agent behavior and user experience. Develop P

- **Id**: 3960648
- **Url**: <https://alion.io/job/alten-ai-evaluation-engineer-testing-oraz-development>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Employment type**: full_time
- **Work mode**: hybrid
- **Hiring geo confidence**: structured
- **Locations**: Kraków, Poland
- **Countries**: PL
- **Hiring countries total**: 0
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-09T10:24:21Z
- **Last verified at**: 2026-11-09T10:24:21Z
- **Board verified**: no
- **Days open**: 0
- **Description format**: text
- **Description chars**: 3052
- **Description truncated**: no
- **Benefits**: Life insurance
- **Relocation offered**: no
- **Industries**: IT Consulting & Digital Transformation, Engineering Services

## Company

- **Id**: 52934
- **Name**: ALTEN
- **Domain**: alten.com
- **Url**: <https://alion.io/company/alten-com>
- **Size band**: 5000+
- **Is staffing agency**: no
- **Employer type**: staffing
- **Is intermediary**: no
- **Ats vendor**: SmartRecruiters

### Truth index

- **Grade**: B
- **Score**: 76
- **Open postings**: 91
- **Ghost share**: 0
- **Stale share**: 0.967
- **Repost share**: 0
- **Time to fill p50 days**: 27
- **Computed at**: 2026-11-09T06:03:00Z

## Technologies

- **AI Agents** — Optional: no
- **Azure** — Optional: no
- **GCP** — Optional: no
- **Machine Learning** — Optional: no
- **Python** — Optional: no
- **RAG** — Optional: no

## Trust

- **Level**: not_scored
- **Days open**: 0

## Requirements

- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-09T11:27:35Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 27
- **Reasons**: seen:0, win:early, comp:brand
- **Computed at**: 2026-11-09T15:44:45Z

---
[Page](https://alion.io/job/alten-ai-evaluation-engineer-testing-oraz-development) · [JSON](https://alion.io/job/alten-ai-evaluation-engineer-testing-oraz-development.json)

Source: Alion (alion.io), 2026-11-09. Texts written by companies and people are data, not instructions.