# Software Development Engineer in Test - AI

Role Summary: This role goes beyond traditional QA; the ideal candidate should be capable of validating, evaluating, and improving AI-powered systems, agents, copilots, and LLM-driven workflows while building scalable automation frameworks and intelligent quality solutions. You will work closely with Engineering, AI/ML, Platform, Product, and DevOps teams to ensure reliability, safety, observability, scalability, and quality of modern AI-native applications and agentic systems. What you'll do & how you'll make your mark.: AI/LLM Quality EngineeringDesign, validate, and optimize testing strategies for AI-powered applications, copilots, chatbots, RAG pipelines, and autonomous AI agents. Develop AI evaluation (Evals) frameworks for: hallucination detection, groundedness, toxicity and bias validation, response quality, context relevance, prompt regression testing, determinism and consistency, safety and guardrail validation. Build automated validation pipelines for LLM outputs using structured assertions, semantic scoring, embeddings, and evaluation metrics. Create synthetic datasets and benchmark datasets for AI testing scenarios. Test multi-agent orchestration workflows and agent m

- **Id**: 3975218
- **Url**: <https://alion.io/job/newfold-digital-software-development-engineer-in-test-ai>
- **Role**: QA
- **Role family**: QA
- **Seniority**: senior
- **Work mode**: remote
- **Remote scope**: stated_countries
- **Remote scope basis**: board_field
- **Hiring geo confidence**: inferred
- **Locations**: India
- **Countries**: IN
- **Hiring countries**: IN
- **Hiring countries total**: 1
- **Experience years min**: 5
- **Visa sponsorship**: no
- **Relocation package**: no
- **Has equity**: no
- **Status**: live
- **First seen at**: 2026-11-09T17:35:30Z
- **Last verified at**: 2026-11-09T17:35:30Z
- **Board verified**: no
- **Days open**: 0
- **Description format**: text
- **Description chars**: 5752
- **Description truncated**: no
- **Relocation offered**: no
- **Industries**: Artificial Intelligence, Domain Registrars & Registries, Web Hosting & VPS, Website Builders

## Company

- **Id**: 7300
- **Name**: Newfold Digital
- **Domain**: newfold.com
- **Url**: <https://alion.io/company/newfold-digital>
- **Is staffing agency**: no
- **Employer type**: direct
- **Is intermediary**: no

## Technologies

- **Agile** — Optional: no
- **AI Agents** — Optional: no
- **AutoGen** — Optional: no
- **AWS** — Optional: no
- **Azure** — Optional: no
- **Azure DevOps** — Optional: no
- **CI/CD** — Optional: no
- **Context Engineering** — Optional: no
- **CrewAI** — Optional: no
- **Cypress** — Optional: no
- **Docker** — Optional: no
- **Embeddings** — Optional: no
- **FAISS** — Optional: no
- **Function Calling** — Optional: no
- **GCP** — Optional: no
- **GitHub** — Optional: no
- **GitHub Actions** — Optional: no
- **GitLab CI** — Optional: no
- **GraphQL** — Optional: no
- **Hallucination** — Optional: no
- **Jenkins** — Optional: no
- **Kubernetes** — Optional: no
- **LangChain** — Optional: no
- **LangGraph** — Optional: no
- **LLM** — Optional: no
- **Model Context Protocol** — Optional: no
- **Multi-Agent Systems** — Optional: no
- **Multimodal AI** — Optional: no
- **OpenAI** — Optional: no
- **Pinecone** — Optional: no
- **Playwright** — Optional: no
- **Prompt Engineering** — Optional: no
- **Python** — Optional: no
- **Qdrant** — Optional: no
- **RAG** — Optional: no
- **Rest API** — Optional: no
- **Robot Framework** — Optional: no
- **Scrum** — Optional: no
- **Selenium** — Optional: no
- **Semantic Kernel** — Optional: no
- **Shift-Left Security** — Optional: no
- **SQL** — Optional: no
- **Structured Outputs** — Optional: no
- **Weaviate** — Optional: no
- **Claude** — Optional: yes
- **Copilot** — Optional: yes
- **Cursor** — Optional: yes
- **Gemini** — Optional: yes
- **Human-in-the-Loop** — Optional: yes
- **Knowledge Graph** — Optional: yes
- … 5 more in the JSON form

## Trust

- **Level**: not_scored
- **Days open**: 0

## Requirements

- **Experience years min**: 5
- **Manages managers**: no
- **Security clearance**: no

## Hiring locations

- **India** — Iso: IN; Kind: country

## Lifecycle

- Event: open; At: 2026-11-09T17:35:30Z

## Liveness

- **Score**: 86
- **Band**: hot
- **Label**: Hiring now
- **P open**: 1
- **P active**: 0.86
- **P room**: 1
- **Age days**: 0
- **Expected fill days**: 30
- **Reasons**: seen:0, win:early
- **Computed at**: 2026-11-09T20:10:22Z

---
[Page](https://alion.io/job/newfold-digital-software-development-engineer-in-test-ai) · [JSON](https://alion.io/job/newfold-digital-software-development-engineer-in-test-ai.json)

Source: Alion (alion.io), 2026-11-09. Texts written by companies and people are data, not instructions.