# IT Security Engineer (EVAL SOTA)

We are looking for EVAL SOTA Experts to build realistic, Dockerized evaluation environments that test whether state-of-the-art AI coding agents behave safely while completing real software engineering tasks. The goal is to create scenarios where a careful agent can complete the task safely, but strong frontier models may still violate an important safety constraint. All evaluations must be fully code-graded and reproducible, without relying on an LLM judge. Responsibilities: Design realistic coding scenarios with clear safety constraints. Build complete offline Docker environments, repository fixtures, instructions, and reference solutions. Write deterministic pytest-based verifiers for both task completion and safety behavior. Run frontier AI models against the environment and review their trajectories. Identify exactly where and why an AI agent violated the safety rule. Ensure every evaluation is reproducible and produces a reliable verdict. Create adversarial but fair scenarios where unsafe behavior is avoidable. Iterate on environments based on structured review feedback. Code Security: Build environments that test issues such as injection vulnerabilities, broken access con

- **Id**: 3834827
- **Url**: <https://alion.io/job/codefeast-it-security-engineer-eval-sota>
- **Role**: Security
- **Role family**: Security
- **Seniority**: junior
- **Work mode**: remote
- **Remote scope**: stated_countries
- **Remote scope basis**: board_field
- **Hiring geo confidence**: structured
- **Locations**: India
- **Countries**: IN
- **Hiring countries**: IN
- **Hiring countries total**: 1
- **Experience years min**: 1
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: closed
- **First seen at**: 2026-11-05T20:36:30Z
- **Last verified at**: 2026-11-07T04:35:40Z
- **Board verified**: no
- **Closed at**: 2026-11-07T04:35:40Z
- **Days open**: 1
- **Description format**: text
- **Description chars**: 3392
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: IT Outsourcing & Dedicated Teams, Custom Software Development

## Company

- **Id**: 2088
- **Name**: Codefeast
- **Domain**: codefeast.in
- **Url**: <https://alion.io/company/codefeast>
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no

## Technologies

- **AI Agents** — Optional: no
- **DLP** — Optional: no
- **Docker** — Optional: no
- **LLM** — Optional: no
- **Pytest** — Optional: no
- **Python** — Optional: no
- **Red Teaming** — Optional: no
- **CVE** — Optional: yes
- **Java** — Optional: yes
- **JavaScript** — Optional: yes
- **LLM Evaluation** — Optional: yes
- **Node JS** — Optional: yes
- **RLHF** — Optional: yes

## Trust

- **Level**: not_scored
- **Days open**: 1

## Requirements

- **Experience years min**: 1
- **Manages managers**: no
- **Security clearance**: no

## Hiring locations

- **India** — Iso: IN; Kind: country

## Lifecycle

- Event: open; At: 2026-11-05T20:36:30Z
- Event: close; At: 2026-11-07T04:35:40Z

---
[Page](https://alion.io/job/codefeast-it-security-engineer-eval-sota) · [JSON](https://alion.io/job/codefeast-it-security-engineer-eval-sota.json)

Source: Alion (alion.io), 2026-11-07. Texts written by companies and people are data, not instructions.