{"id":4640120,"url":"https://alion.io/job/dassault-systemes-ai-llm-quality-engineering-coordinator","title":"AI & LLM Quality Engineering Coordinator","company":{"id":144,"name":"Dassault Systemes","domain":"3ds.com","url":"https://alion.io/company/dassault-systemes","size_band":"5000+","is_staffing_agency":false,"employer_type":"direct","is_intermediary":false,"listed_via":null,"ats_vendor":"Schema","truth_index":{"grade":"B","score":83,"open_postings":26,"ghost_share":0,"stale_share":0.692,"repost_share":0,"time_to_fill_p50_days":41,"computed_at":"2026-11-19T09:08:57Z"}},"role":"AI/ML","role_family":"AI/ML","seniority":null,"employment_type":"full_time","work_mode":"on_site","remote_scope":null,"remote_scope_basis":null,"remote_working_hours":null,"hiring_geo_confidence":"structured","locations":["Johnston, United States"],"countries":["US"],"hiring_countries":[],"hiring_countries_total":0,"salary":{"min":110000,"max":140000,"currency":"USD","period":"year","gross":null,"usd_annual":140000},"salary_estimate":null,"experience_years_min":null,"visa_sponsorship":false,"relocation_package":false,"has_equity":false,"technologies":[{"name":"Agentic Workflows","optional":false},{"name":"AI Agents","optional":false},{"name":"CI/CD","optional":false},{"name":"Hallucination","optional":false},{"name":"LLM","optional":false},{"name":"Prompt Engineering","optional":false},{"name":"Python","optional":false},{"name":"RAG","optional":false},{"name":"DeepEval","optional":true},{"name":"LangSmith","optional":true},{"name":"Pytest","optional":true}],"status":"live","first_seen_at":"2026-11-16T09:11:47Z","employer_posted_date":"2026-11-16","last_verified_at":"2026-11-19T22:07:55Z","board_verified":true,"closed_at":null,"days_open":3,"trust":{"level":"ok","repost_count":null,"flags":[],"days_open":3},"description":"AI & LLM Quality Engineering Coordinator\nUnited States, RI, Johnston\nRegular\nApply\nKey Job Details\nLocation:\nUnited States, RI, Johnston\nJob type:\nRegular\nProduct:\nSIMULIA\nExperience level:\n4 to 5 years\nPosted on:\n11/16/2026\nRef ID:\n550948\nShare Job\nRole Description & Responsibilities\nWe are seeking a sharp, communicative, and technically grounded AI & LLM Quality Engineering Coordinator to lead and advance the testing of Large Language Model (LLM) features integrated into our 3DEXPERIENCE physics and simulation applications.\nIn this role, you will bridge the gap between cutting-edge generative AI and complex engineering simulation software. You will coordinate cross-functional testing efforts, design automated evaluation frameworks, and ensure our AI-driven workflows meet the high standards of accuracy, reliability, and scientific rigor our engineering customers depend on.\nKey Responsibilities\nCoordinate LLM Testing Initiatives: Plan, organize, and track end-to-end validation efforts across multiple physics simulation applications, ensuring alignment between AI developers, domain physics engineers, and QA teams.\n\nAdvance Automated Evaluation: Design, build, and maintain automated test harnesses to evaluate LLM outputs-focusing on accuracy, hallucination detection, reasoning consistency, and adherence to physical and engineering constraints.\n\nExpand Test Coverage & Methodologies: Develop scalable testing methodologies, including synthetic dataset generation, regression benchmarks, and LLM-as-a-judge evaluation pipelines.\n\nCommunicate Quality & Release Readiness: Translate complex model performance metrics, failure modes, and risk assessments into clear, actionable insights for R&D leadership and engineering stakeholders.\n\nDrive Continuous Improvement: Stay current with emerging LLM evaluation frameworks and industry best practices to continuously modernize our AI quality engineering processes.\n\nQualifications\nEducation: Master’s degree in Artificial Intelligence, Computer Science, Data Science, Computational Linguistics, or an equivalent technical discipline.\n Deep LLM Expertise: Strong theoretical and practical understanding of Large Language Models, prompt engineering, Retrieval-Augmented Generation (RAG), agentic workflows, and common LLM failure modes.\n Test Automation Experience: Proven ability to write clean, maintainable code (e.g., Python) to automate software testing, build evaluation pipelines, and integrate automated checks into CI/CD workflows.\nExceptional Communication Skills: Demonstrated ability to collaborate across diverse technical teams, clearly document test strategies, and present findings to both technical and non-technical stakeholders.\nPreferred Qualifications\nPrior hands-on experience in software quality engineering (QE/SDET), AI/ML model validation, or automated testing in a production R&D environment.\nFamiliarity with modern LLM evaluation frameworks and tooling (e.g., DeepEval, RAGAS, LangSmith, PyTest, or custom benchmarking suites).\nAcademic or professional background in mechanical engineering, physics, CAD/CAE, or scientific simulation software.\nInclusion statement\nIn order to provide equal employment and advancement opportunities to all individuals, employment decisions at 3DS are based on merit, qualifications and abilities. 3DS is committed to a policy of non-discrimination and equal opportunity for all employees and qualified applicants without regard to race, color, religion, gender, sex (including pregnancy, childbirth or medical or common conditions related to pregnancy or childbirth), sexual orientation, gender identity, gender expression, marital status, familial status, national origin, ancestry, age (40 and above), disability, veteran status, military service, application for military service, genetic information, receipt of free medical care, or any other characteristic protected under applicable law. 3DS will make reasonable accommodations for qualified individuals with known disabilities, in accordance with applicable law.\nQualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state laws and local ordinances. We are committed to fair employment practices and will evaluate all candidates based on their qualifications, regardless of past arrest or conviction history.\nCompensation & Benefits\nDassault Systèmes offers an excellent salary with potential for bonus, commensurate with experience. Benefits include a choice of plans providing comprehensive coverage for medical, dental, vision care for employee & dependents as well as employee life, short & long term disability, tuition reimbursement, immediate 401K enrollment, 401K match (50 cents on the dollar, up to the first 8% of your eligible compensation that you contribute based on match eligibility criteria), flexible time off policy, and 10 paid holidays.\n Salary Pay Transparency\nCompensation for the role will be commensurate with experience. The total expected compensation range will be between $110000 and $140000, representing the base salary (or annualized salary based on estimated hourly compensation) and target bonus.\nApply\nDassault Systèmes\">\nPowered by the 3D EXPERIENCE® Platform, SIMULIA delivers realistic simulation applications that enable users to reveal the world we live in.\nWant to learn more?\nVisit the other sections of our website to find out more.\nOur Culture & Values\n Discover our culture and values.\nTake me there\nYour Recruitment Journey\n Get to know about your recruitment journey.\nKnow more\nStudents & Graduates\n Be part of the future of our workforce - check out internship and job opportunities.\nLearn more","description_format":"text","description_chars":5686,"description_truncated":false,"requirements":{"experience_years_min":null,"management_years_min":null,"team_size_min":null,"manages_managers":false,"education":{"level":"master","optional":false},"security_clearance":false,"languages":[]},"benefits":["401k plan","Flexible time off"],"hiring_locations":[{"name":"United States","iso":"US","kind":"country"}],"hiring_excludes":[],"relocation_offered":false,"industries":["CAD, PLM & BIM Software","Simulation & Digital Twin Software","Clinical Trial Software","Manufacturing & Industrial Software"],"lifecycle":[{"event":"open","at":"2026-11-19T22:07:55Z"}],"visa":[{"country":"US","licensed_sponsor":true,"adverts_offering_sponsorship_24m":0,"sanctioned_now":false,"evidence":"H-1B filings in 12 months: 106 · green card filings: 44","filings_12m":106,"filings_prev_12m":132,"green_card_filings_12m":44,"median_offered_wage_usd":132333,"route":null,"cap_exempt":false,"checked_at":"2026-11-19T07:44:56+00:00","sources":["US Department of Labor: LCA disclosure data (H-1B, H-1B1, E-3)","US Department of Labor: PERM disclosure data (green cards)"],"filings_for_role_12m":56}],"liveness":{"score":86,"band":"hot","label":"Hiring now","p_open":1,"p_active":0.86,"p_room":1,"age_days":3,"expected_fill_days":41,"reasons":["conf:1","win:early","comp:brand"],"computed_at":"2026-11-19T23:56:47Z"},"pay":{"stated_usd_annual":140000,"is_top_pay":false},"html_url":"https://alion.io/job/dassault-systemes-ai-llm-quality-engineering-coordinator","json_url":"https://alion.io/job/dassault-systemes-ai-llm-quality-engineering-coordinator.json","meta":{"generated_at":"2026-11-19T23:56:47Z","cache_seconds":300,"methodology":"https://alion.io/methodology","terms":"https://alion.io/terms","contact":"https://alion.io/contact","api":"https://alion.io/developers","about":"Alion is a live layer of people, companies and AI agents: who they are, whether they are real and active right now, what they do and how to work with them, readable by people and by agents and paid per call.","catalog":"https://alion.io/catalog.json","usage":{"tier":"crawler_verified","counted_by":"address","units_charged":1,"used_today":180,"day_limit":null,"remaining_today":null,"minute_limit":300,"resets_at":"2026-11-20T00:00:00Z"}},"offers":[{"id":"company.slices","title":"One company in depth, by slice","status":"live","price":{"credits":0.1,"usd":0.01,"plus_per_slice":{"credits":0.05,"usd":0.005}},"unit":"per company, plus each slice with data","note":"the employer in depth","call":{"mcp_tool":"get_company","arguments":{"id":144},"rest":"https://alion.io/mcp/rest/get_company?id=144"},"human":"https://alion.io/catalog?offer=company.slices&for=job%2Fdassault-systemes-ai-llm-quality-engineering-coordinator"},{"id":"market.stats","title":"A market slice: pay, demand and time to fill","status":"free","price":{"credits":0,"usd":0},"unit":"per slice","note":"pay, demand and time to fill for this role and place","call":{"mcp_tool":"market_stats"},"human":"https://alion.io/catalog?offer=market.stats&for=job%2Fdassault-systemes-ai-llm-quality-engineering-coordinator"},{"id":"job.search","title":"Open jobs by role, technology, place, pay and visa","status":"live","price":{"credits":0.1,"usd":0.01},"unit":"per posting in a list","note":"similar open postings","call":{"mcp_tool":"search_jobs"},"human":"https://alion.io/catalog?offer=job.search&for=job%2Fdassault-systemes-ai-llm-quality-engineering-coordinator"},{"id":"company.verify","title":"Is this company real and active right now","status":"pilot","price":null,"unit":"per company","request":{"url":"https://alion.io/catalog/request","method":"POST","body":"{\"offer\": \"company.verify\", \"for\": \"job/dassault-systemes-ai-llm-quality-engineering-coordinator\", \"note\": \"what you need it for\"}"},"human":"https://alion.io/catalog?offer=company.verify&for=job%2Fdassault-systemes-ai-llm-quality-engineering-coordinator"}],"agent":{"mcp":"https://alion.io/mcp/jobs","mcp_open":"https://alion.io/mcp/open","next":[{"tool":"get_job","arguments":{"id":4640120}},{"tool":"search_jobs","arguments":{"company":"3ds.com","detail":"compact"}},{"tool":"match_people","arguments":{"job_id":4640120},"note":"people open to offers who fit this vacancy"}],"note":"The same data through MCP tools: https://alion.io/mcp/open needs no sign-in (compact searches, postings, people); https://alion.io/mcp with an Alion account has everything. Docs: https://alion.io/developers"}}