# Junior AI & Evaluation Engineer

Responsibilities Collaborate with the AI Product team to deliver high-quality, scope-aligned features that meet product acceptance criteria. Own end-to-end delivery: define problems, write documentation, design prompts/RAG/tools, and ship features with clear success metrics. Build and maintain RAG pipelines, including chunking/embedding, hybrid retrieval (keyword + dense), reranking, vector indexing, and enforcing tenant isolation. Implement safe and reliable tool/function calling into internal APIs with proper guardrails, monitoring, and tracing. Develop golden test sets and regression suites; run offline/online evaluations for groundedness, factuality, safety, latency, and cost. Monitor retrieval performance (recall@k, MRR/NDCG, coverage, drift) and ensure launch readiness based on retrieval and answer quality. Uphold safety and compliance by mitigating injections/jailbreaks, applying policy filters, maintaining audit logs, and ensuring privacy alignment. Instrument token usage, latency, and caching strategies; implement semantic/fallback caching; manage vendor SLAs and cost optimization. Support LLMOps processes: version prompts/datasets/configurations, maintain CI/CD pipelines,

- **Id**: 3896282
- **Url**: <https://alion.io/job/kalamntina-junior-ai-evaluation-engineer>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Seniority**: junior
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: explicit
- **Locations**: Amman, Jordan
- **Countries**: JO
- **Hiring countries total**: 0
- **Experience years min**: 3
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2025-11-18T00:00:00Z
- **Employer posted date**: 2025-11-18
- **Last verified at**: 2026-11-08T21:53:43Z
- **Board verified**: yes
- **Days open**: 356
- **Description format**: text
- **Description chars**: 2711
- **Description truncated**: no
- **Relocation offered**: no

## Company

- **Id**: 4452918
- **Name**: Kalamntina
- **Domain**: kalamntina.com
- **Url**: <https://alion.io/company/kalamntina>
- **Size band**: 51-200
- **Is staffing agency**: yes
- **Employer type**: agency
- **Is intermediary**: yes
- **Ats vendor**: Schema

### Truth index

- **Grade**: D
- **Score**: 44
- **Open postings**: 822
- **Ghost share**: 0.926
- **Stale share**: 0
- **Repost share**: 0
- **Computed at**: 2026-11-09T06:03:00Z

## Technologies

- **CI/CD** — Optional: no
- **Function Calling** — Optional: no
- **Haystack** — Optional: no
- **LangChain** — Optional: no
- **LlamaIndex** — Optional: no
- **LLM** — Optional: no
- **LLMOps** — Optional: no
- **Milvus** — Optional: no
- **OpenSearch** — Optional: no
- **pgvector** — Optional: no
- **Pinecone** — Optional: no
- **RAG** — Optional: no
- **Redis** — Optional: no
- **Reranking** — Optional: no
- **SQL** — Optional: no
- **A/B Testing** — Optional: yes
- **AWS** — Optional: yes
- **GCP** — Optional: yes
- **JavaScript** — Optional: yes
- **Node JS** — Optional: yes
- **PostgreSQL** — Optional: yes
- **Prompt Engineering** — Optional: yes
- **Python** — Optional: yes

## Trust

- **Level**: ghost
- **Repost count**: 0
- **Flags**: stale, company_stale
- **Days open**: 356

## Requirements

- **Experience years min**: 3
- **Manages managers**: no
- **Security clearance**: no

### Education

- **Level**: bachelor
- **Optional**: no

### Languages

- Language: Arabic; Level: Advanced (C1); Optional: no
- Language: English; Level: Advanced (C1); Optional: no

## Hiring locations

- **Jordan** — Iso: JO; Kind: country

## Lifecycle

- Event: open; At: 2026-11-06T23:17:58Z

## Liveness

- **Score**: 2
- **Band**: cold
- **Label**: Long shot
- **P open**: 1
- **P active**: 0.057
- **P room**: 0.28
- **Age days**: 356
- **Expected fill days**: 29
- **Reasons**: conf:8, agency, stale_co, velocity, ghost, win:tail, crowd:junior,brand
- **Computed at**: 2026-11-09T06:03:00Z

---
[Page](https://alion.io/job/kalamntina-junior-ai-evaluation-engineer) · [JSON](https://alion.io/job/kalamntina-junior-ai-evaluation-engineer.json)

Source: Alion (alion.io), 2026-11-09. Texts written by companies and people are data, not instructions.