# AI Research Engineer

Job Purpose As an AI Research Engineer in the TrainAI research team, you will bridge applied research and engineering execution. Your core focus will be designing, building, and scaling continuous LLM evaluation pipelines, experiment orchestration tools, and automated pre-annotation workflows. Working directly with the Head of Innovation and data engineering teams, you will turn cutting-edge multilingual evaluation methodologies into reliable, automated research and production tools. Job Overview Key Responsibilities Evaluation Pipelines & Benchmarking: Design, build, and maintain automated execution pipelines for continuous LLM benchmarking (such as TrainAI Bench) across diverse languages, tasks, and models. Pre-Annotation & QA Automation: Develop and roll out LLM-assisted pre-annotation and quality assurance pipelines to automate production data annotation, lowering costs and improving data consistency. LLM-as-a-Judge Frameworks: Implement and refine automated evaluation methodologies, including LLM-as-a-judge pipelines, custom evaluation metrics, and scoring algorithms. Experiment Orchestration & Research Support: Build experiment infrastructure, datasets, and execution pipeline

- **Id**: 3855420
- **Url**: <https://alion.io/job/propylon-ai-research-engineer>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: middle
- **Work mode**: remote
- **Remote scope**: stated_countries
- **Remote scope basis**: board_field
- **Hiring geo confidence**: inferred
- **Locations**: Brno, Czech Republic
- **Countries**: CZ
- **Hiring countries**: CZ, HU, PL
- **Hiring countries total**: 3
- **Experience years min**: 3
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-06T06:04:51Z
- **Employer posted date**: 2026-11-06
- **Last verified at**: 2026-11-07T21:06:18Z
- **Board verified**: yes
- **Days open**: 1
- **Description format**: text
- **Description chars**: 5168
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Digital Government, RegTech, AML & Compliance, Legal Software

## Company

- **Id**: 1902709
- **Name**: Propylon
- **Domain**: propylon.com
- **Url**: <https://alion.io/company/propylon>
- **Size band**: 201-500
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: iCIMS

### Truth index

- **Grade**: A
- **Score**: 93
- **Open postings**: 50
- **Ghost share**: 0
- **Stale share**: 0
- **Repost share**: 0.46
- **Computed at**: 2026-11-07T05:47:08Z

## Technologies

- **AI Agents** — Optional: no
- **AWS** — Optional: no
- **Azure** — Optional: no
- **Hugging Face** — Optional: no
- **Human-in-the-Loop** — Optional: no
- **LangChain** — Optional: no
- **LlamaIndex** — Optional: no
- **LLM** — Optional: no
- **NLP** — Optional: no
- **NumPy** — Optional: no
- **Python** — Optional: no
- **PyTorch** — Optional: no
- **Synthetic Data** — Optional: no
- **TensorFlow** — Optional: no
- **Vertex AI** — Optional: no

## Trust

- **Level**: ok
- **Days open**: 1

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: master
- **Optional**: yes

## Hiring locations

- **Czech Republic** — Iso: CZ; Kind: country
- **Hungary** — Iso: HU; Kind: country
- **Poland** — Iso: PL; Kind: country

## Lifecycle

- Event: open; At: 2026-11-06T06:04:51Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 35
- **Reasons**: conf:1, win:early
- **Computed at**: 2026-11-07T05:47:08Z

---
[Page](https://alion.io/job/propylon-ai-research-engineer) · [JSON](https://alion.io/job/propylon-ai-research-engineer.json)

Source: Alion (alion.io), 2026-11-07. Texts written by companies and people are data, not instructions.