# Software Engineering & DevOps AI RaterEvaluator

OverviewLILT is building a global network of domain experts to support high-quality AI evaluation across training benchmarking red-teaming and ongoing model monitoring. We are seeking software engineering and DevOps professionals to contribute expert judgment to human-in-the-loop AI evaluation workflows used by leading enterprises and hyperscalers. This role is designed for professionals who understand how software systems infrastructure and development practices work in real production environments and who can apply that expertise to evaluate assess and improve multilingual AI systems. Your contribution of expertise will directly influence multilingual AI model quality safety and deployment readiness. This role includes two distinct expert tracks based on experience level and scope of responsibility. Track A: Software Engineering & DevOps AI RaterRaters execute structured evaluation tasks using clearly defined rubrics and instructions. Responsibilities Evaluate AI outputs related to software engineering DevOps and infrastructure topics Perform structured scoring comparison classification and judgment tasks Assess technical correctness completeness security implications and best-

- **Id**: 4784363
- **Url**: <https://alion.io/job/lilt-software-engineering-devops-ai-raterevaluator>
- **Role**: DevOps
- **Role family**: DevOps
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: Riyadh, Saudi Arabia
- **Countries**: SA
- **Hiring countries total**: 0
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-20T00:00:00Z
- **Last verified at**: 2026-11-20T00:00:00Z
- **Board verified**: no
- **Days open**: 2
- **Description format**: text
- **Description chars**: 5934
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Natural Language Processing, Translation Services

## Company

- **Id**: 6416
- **Name**: Lilt
- **Domain**: lilt.com
- **Url**: <https://alion.io/company/lilt>
- **Size band**: 51-200
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no
- **Ats vendor**: Ashby

### Truth index

- **Grade**: A
- **Score**: 92
- **Open postings**: 235
- **Ghost share**: 0.043
- **Stale share**: 0
- **Repost share**: 0
- **Time to fill p50 days**: 68
- **Computed at**: 2026-11-20T05:46:30Z

## Technologies

- **CI/CD** — Optional: no
- **Human-in-the-Loop** — Optional: no

## Trust

- **Level**: not_scored
- **Days open**: 2

## Requirements

- **Manages managers**: no
- **Security clearance**: no

## Lifecycle

- Event: open; At: 2026-11-22T08:18:15Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 2
- **Expected fill days**: 68
- **Reasons**: seen:2, win:early, comp:brand
- **Computed at**: 2026-11-22T09:29:45Z

---
[Page](https://alion.io/job/lilt-software-engineering-devops-ai-raterevaluator) · [JSON](https://alion.io/job/lilt-software-engineering-devops-ai-raterevaluator.json)

Source: Alion (alion.io), 2026-11-22. Texts written by companies and people are data, not instructions.
