2,408,630open jobs
149,843companies
298,159added this week
Browse all
Salary
$110k – $140k per year
Location
In office (Johnston)
Visa
H-1B filings in 12 months: 106 · for this role: 56 · green card filings: 44
Employment
Full-Time

Confirmed on the employer's own hiring board on Nov 19, 2026. First seen by Alion on Nov 16, 2026. Dassault Systemes scores B on the Alion truth index.

Overview
Company
Impact
Profile match
Dassault Systemes is a French software company founded in 1981 as a spin-off from the aircraft maker Dassault Aviation, created to commercialise the three-dimensional design tools its engineers had built in house. It sells the CATIA and SOLIDWORKS design suites, SIMULIA simulation, ENOVIA lifecycle management and DELMIA manufacturing planning, all now delivered through the 3DEXPERIENCE platform that treats a product as one connected model from concept to service. The group has extended the same virtual twin idea into life sciences through the Medidata clinical trial platform and into urban and healthcare simulation, and it is headquartered in Velizy-Villacoublay near Paris.

AI & LLM Quality Engineering Coordinator

United States, RI, Johnston

Regular

Apply

Key Job Details

Location:

United States, RI, Johnston

Job type:

Regular

Product:

SIMULIA

Experience level:

4 to 5 years

Posted on:

11/16/2026

Ref ID:

550948

Share Job

Role Description & Responsibilities

We are seeking a sharp, communicative, and technically grounded AI & LLM Quality Engineering Coordinator to lead and advance the testing of Large Language Model (LLM) features integrated into our 3DEXPERIENCE physics and simulation applications.

In this role, you will bridge the gap between cutting-edge generative AI and complex engineering simulation software. You will coordinate cross-functional testing efforts, design automated evaluation frameworks, and ensure our AI-driven workflows meet the high standards of accuracy, reliability, and scientific rigor our engineering customers depend on.

Key Responsibilities

  • Coordinate LLM Testing Initiatives: Plan, organize, and track end-to-end validation efforts across multiple physics simulation applications, ensuring alignment between AI developers, domain physics engineers, and QA teams.

  • Advance Automated Evaluation: Design, build, and maintain automated test harnesses to evaluate LLM outputs-focusing on accuracy, hallucination detection, reasoning consistency, and adherence to physical and engineering constraints.

  • Expand Test Coverage & Methodologies: Develop scalable testing methodologies, including synthetic dataset generation, regression benchmarks, and LLM-as-a-judge evaluation pipelines.

  • Communicate Quality & Release Readiness: Translate complex model performance metrics, failure modes, and risk assessments into clear, actionable insights for R&D leadership and engineering stakeholders.

  • Drive Continuous Improvement: Stay current with emerging LLM evaluation frameworks and industry best practices to continuously modernize our AI quality engineering processes.

Qualifications

  • Education: Master’s degree in Artificial Intelligence, Computer Science, Data Science, Computational Linguistics, or an equivalent technical discipline.
  • Deep LLM Expertise: Strong theoretical and practical understanding of Large Language Models, prompt engineering, Retrieval-Augmented Generation (RAG), agentic workflows, and common LLM failure modes.
  • Test Automation Experience: Proven ability to write clean, maintainable code (e.g., Python) to automate software testing, build evaluation pipelines, and integrate automated checks into CI/CD workflows.
  • Exceptional Communication Skills: Demonstrated ability to collaborate across diverse technical teams, clearly document test strategies, and present findings to both technical and non-technical stakeholders.

Preferred Qualifications

  • Prior hands-on experience in software quality engineering (QE/SDET), AI/ML model validation, or automated testing in a production R&D environment.
  • Familiarity with modern LLM evaluation frameworks and tooling (e.g., DeepEval, RAGAS, LangSmith, PyTest, or custom benchmarking suites).
  • Academic or professional background in mechanical engineering, physics, CAD/CAE, or scientific simulation software.

Inclusion statement

In order to provide equal employment and advancement opportunities to all individuals, employment decisions at 3DS are based on merit, qualifications and abilities. 3DS is committed to a policy of non-discrimination and equal opportunity for all employees and qualified applicants without regard to race, color, religion, gender, sex (including pregnancy, childbirth or medical or common conditions related to pregnancy or childbirth), sexual orientation, gender identity, gender expression, marital status, familial status, national origin, ancestry, age (40 and above), disability, veteran status, military service, application for military service, genetic information, receipt of free medical care, or any other characteristic protected under applicable law. 3DS will make reasonable accommodations for qualified individuals with known disabilities, in accordance with applicable law.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state laws and local ordinances. We are committed to fair employment practices and will evaluate all candidates based on their qualifications, regardless of past arrest or conviction history.

Compensation & Benefits

Dassault Systèmes offers an excellent salary with potential for bonus, commensurate with experience. Benefits include a choice of plans providing comprehensive coverage for medical, dental, vision care for employee & dependents as well as employee life, short & long term disability, tuition reimbursement, immediate 401K enrollment, 401K match (50 cents on the dollar, up to the first 8% of your eligible compensation that you contribute based on match eligibility criteria), flexible time off policy, and 10 paid holidays.

Salary Pay Transparency

Compensation for the role will be commensurate with experience. The total expected compensation range will be between $110000 and $140000, representing the base salary (or annualized salary based on estimated hourly compensation) and target bonus.

Apply

Dassault Systèmes">

Powered by the 3D EXPERIENCE® Platform, SIMULIA delivers realistic simulation applications that enable users to reveal the world we live in.

Want to learn more?

Visit the other sections of our website to find out more.

Our Culture & Values

Discover our culture and values.

Take me there

Your Recruitment Journey

Get to know about your recruitment journey.

Know more

Students & Graduates

Be part of the future of our workforce - check out internship and job opportunities.

Learn more

Free account
Stop reading job ads. Get the ones that fit.
One free account turns this page into a shortlist built around your stack, your level and your pay.
Match on every job. Stack, seniority, pay and location, scored against your profile.
2,408,630 open roles. Read straight off company career pages, refreshed every day.
Unlimited applications. Every one you send is tracked in one place, on-site or on a company board.
3 tailored CVs a month. Rewritten for the exact job you are applying to. Included free.
Create a free account Continue with Google
Free forever. No card. Under a minute.

Your match

How well do you fit this role?
Two answers are enough for a real match. No account needed.
Check my fit
Answers stay in this browser until you create an account.

Recommended for you based on this role

AI/ML
Remote, many countries
Similar stack
Same company
Johnston
In office · Contractor · Raleigh
Python
SQL
AI/ML
Fine-tuning
LLM
RAG
Apply
In office · Contractor · 2+ years exp · Bachelor's Degree · Mountain View
Python
AI/ML
LangGraph
AutoGen
LangChain
Model Context Protocol
Embeddings
Function Calling
AI Agents
CrewAI
LLM
RAG
Reranking
OpenAI
OpenAI Agents SDK
Semantic Search
Multi-Agent Systems
Machine Learning
DevOps
Azure
Git
Apply
$170k – $230k per year · In office · Full-Time · 7+ years exp · Bachelor's Degree · San Jose · Indianapolis
AI/ML
AI Agents
LLM
Context Engineering
Multi-Agent Systems
Machine Learning
Cybersecurity
SOC 2
HIPAA
Life Sciences
LIMS
MedTech
21 CFR Part 11
Apply
Equity · In office · Full-Time · Hartford
C#
C#
ASP.NET Core
AI/ML
Claude
Claude Code
Model Context Protocol
Function Calling
AI Agents
AWS Bedrock
RAG
Anthropic
Human-in-the-Loop
Context Engineering
LLM Guardrails
DevOps
Rest API
CI/CD
AWS
IAM
QA
Rest-Assured
Apply
AI Architect 1 hour ago
$80k – $158k per year · In office · 10+ years exp · Minneapolis
Databases
Azure Cosmos DB
AI/ML
LangGraph
AutoGen
LangChain
Model Context Protocol
AI Agents
Semantic Kernel
RAG
Hybrid Search
OpenAI
LLMOps
GraphRAG
Human-in-the-Loop
Context Engineering
Knowledge Graph
LLM Guardrails
Copilot Studio
DevOps
Azure
Cybersecurity
Microsoft Entra ID
Management
ServiceNow
Power Automate
Apply
$36k – $54k per year · Remote (likely EAEU) · Full-Time · Glubokoye
Python
SQL
C#
AI/ML
Model Context Protocol
AI Agents
LLM
RAG
DevOps
Rest API
CI/CD
Git
Apply
Remote (EAEU) · Full-Time · Moscow
Python
SQL
Python
Flask
FastAPI
Databases
PostgreSQL
ClickHouse
Milvus
Qdrant
Apache Kafka
Trino
AI/ML
Airflow
MLFlow
NLP
TensorRT
PyTorch
ClearML
Triton
Machine Learning
DevOps
Docker
Kubernetes
GitLab
Apply
1203 - AI Engineer 1 day ago
$72k – $78k per year · Remote (LATAM, US time zones hours) · Full-Time · 5+ years exp
Python
AI/ML
LangChain
LlamaIndex
Scikit-learn
PyTorch
LLM
RAG
Anomaly Detection
LLM Guardrails
NIST AI RMF
DevOps
Splunk
Azure
AWS
Cybersecurity
Microsoft Sentinel
OWASP Top 10
SIEM
Apply
AI/ML Engineer 1 day ago
Remote (Europe) · 4+ years exp · Bachelor's Degree · Pune
Python
SQL
Databases
Google BigQuery
AI/ML
Copilot
Cursor
Spark
Claude Code
Scikit-learn
AI Agents
LLM
Statsmodels
LLM Guardrails
Machine Learning
DevOps
Terraform
GCP
CI/CD
AWS
Docker
Kubernetes
Wi-Fi
Apply
Remote (DACH) · Full-Time
Python
TypeScript
AI/ML
Model Context Protocol
MLFlow
Vertex AI
AI Agents
AWS Bedrock
Kubeflow
LLM
RAG
Reranking
EU AI Act
DevOps
OpenShift
Helm
Prometheus
Azure
CI/CD
ArgoCD
Git
AWS
Docker
Kubernetes
Grafana
Cybersecurity
ISO 27001
Apply
In office · Full-Time · Johnston
Life Sciences
GMP
Apply
In office · Johnston
Apply
In office · Johnston
Apply
$180k – $243k per year · In office · 8+ years exp · Bachelor's Degree · Johnston
Management
Agile
Apply
$140k – $190k per year · Hybrid · 8+ years exp · Bachelor's Degree · Johnston
AI/ML
Red Teaming
Cybersecurity
MITRE ATT&CK
Apply
See all jobs
This is one of many
2,408,630 more open roles from verified company boards, updated every day.