# Machine Learning Engineer / SME (LLM Eval & RAG Testing) – SME | TS/SCI

Active TS/SCI required. U.S. citizenship required. Location: On-site in McLean, VA (Full-Time). Prove which LLMs actually work for the mission. You'll design RAG and LLM evaluation experiments, tune models on custom data, and run GPU-accelerated benchmarks so the team ships AI systems they can trust. What you'll do Test, evaluate and validate AI systems with a focus on LLM-based systems (including RAG testing) Design and run experiments that benchmark LLMs against defined measures Tune neural networks / LLMs on custom datasets and apply results to concrete use cases Build AI/ML models and ensembles in Python or R (library selection, preprocessing, model assessment) Use deep learning frameworks such as PyTorch, TensorFlow or Keras Leverage GPUs for accelerated training and evaluation Write solid SQL (CTEs, set operations, aggregates, nested subqueries) against analytical datasets Work in GitHub and Jenkins-style CI for reproducible experiments Communicate methodological choices and model results to technical and non-technical stakeholders What you bring (required) Active TS/SCI Hands-on RAG testing experience (must-have) Tuning neural nets / LLMs on custom datasets for real use case

- **Id**: 4199047
- **Url**: <https://alion.io/job/falls-technology-machine-learning-engineer-sme-llm-eval-rag-testing-sme-tssci-2>
- **Role**: AI/ML
- **Role family**: AI/ML
- **Employment type**: full_time
- **Work mode**: on_site
- **Hiring geo confidence**: structured
- **Locations**: McLean, United States
- **Countries**: US
- **Hiring countries total**: 0
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-10-28T00:00:00Z
- **Employer posted date**: 2026-10-28
- **Last verified at**: 2026-11-18T07:03:12Z
- **Board verified**: yes
- **Days open**: 21
- **Description format**: text
- **Description chars**: 2325
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Systems Integrators, Custom Software Development

## Company

- **Id**: 4483010
- **Name**: Falls Technology
- **Domain**: fallstechnology.com
- **Url**: <https://alion.io/company/falls-technology>
- **Is staffing agency**: no
- **Employer type**: services
- **Is intermediary**: no
- **Ats vendor**: Schema

## Technologies

- **GitHub** — Optional: no
- **Jenkins** — Optional: no
- **Keras** — Optional: no
- **LLM** — Optional: no
- **Python** — Optional: no
- **PyTorch** — Optional: no
- **RAG** — Optional: no
- **SQL** — Optional: no
- **TensorFlow** — Optional: no
- **Explainable AI** — Optional: yes
- **Flask** — Optional: yes
- **Hugging Face** — Optional: yes
- **ONNX** — Optional: yes
- **Scikit-learn** — Optional: yes
- **Semantic Search** — Optional: yes
- **Tableau** — Optional: yes
- **Transformers** — Optional: yes

## Trust

- **Level**: ok
- **Days open**: 21

## Requirements

- **Manages managers**: no
- **Security clearance**: yes

## Hiring locations

- **United States** — Iso: US; Kind: country

## Lifecycle

- Event: open; At: 2026-11-12T21:31:02Z

## Liveness

- **Score**: 63
- **Band**: ok
- **Label**: Likely open
- **P open**: 1
- **P active**: 0.835
- **P room**: 0.75
- **Age days**: 21
- **Expected fill days**: 26
- **Reasons**: conf:4, velocity, win:late
- **Computed at**: 2026-11-18T05:48:20Z

---
[Page](https://alion.io/job/falls-technology-machine-learning-engineer-sme-llm-eval-rag-testing-sme-tssci-2) · [JSON](https://alion.io/job/falls-technology-machine-learning-engineer-sme-llm-eval-rag-testing-sme-tssci-2.json)

Source: Alion (alion.io), 2026-11-18. Texts written by companies and people are data, not instructions.
