We use cookies. Find out more about it here. By continuing to browse this site you are agreeing to our use of cookies.
#alert
Back to search results
New

AI & LLM Quality Engineering Coordinator

Dassault Systemes
paid holidays, long term disability, tuition reimbursement, flex time, 401(k)
United States, Rhode Island, Johnston
1301 Atwood Avenue (Show on map)
Nov 17, 2026
Role Description & Responsibilities

We are seeking a sharp, communicative, and technically grounded AI & LLM Quality Engineering Coordinator to lead and advance the testing of Large Language Model (LLM) features integrated into our 3DEXPERIENCE physics and simulation applications.

In this role, you will bridge the gap between cutting-edge generative AI and complex engineering simulation software. You will coordinate cross-functional testing efforts, design automated evaluation frameworks, and ensure our AI-driven workflows meet the high standards of accuracy, reliability, and scientific rigor our engineering customers depend on.

Key Responsibilities

  • Coordinate LLM Testing Initiatives: Plan, organize, and track end-to-end validation efforts across multiple physics simulation applications, ensuring alignment between AI developers, domain physics engineers, and QA teams.

  • Advance Automated Evaluation: Design, build, and maintain automated test harnesses to evaluate LLM outputs-focusing on accuracy, hallucination detection, reasoning consistency, and adherence to physical and engineering constraints.

  • Expand Test Coverage & Methodologies: Develop scalable testing methodologies, including synthetic dataset generation, regression benchmarks, and LLM-as-a-judge evaluation pipelines.

  • Communicate Quality & Release Readiness: Translate complex model performance metrics, failure modes, and risk assessments into clear, actionable insights for R&D leadership and engineering stakeholders.

  • Drive Continuous Improvement: Stay current with emerging LLM evaluation frameworks and industry best practices to continuously modernize our AI quality engineering processes.

Qualifications
  • Education: Master's degree in Artificial Intelligence, Computer Science, Data Science, Computational Linguistics, or an equivalent technical discipline.
  • Deep LLM Expertise: Strong theoretical and practical understanding of Large Language Models, prompt engineering, Retrieval-Augmented Generation (RAG), agentic workflows, and common LLM failure modes.
  • Test Automation Experience: Proven ability to write clean, maintainable code (e.g., Python) to automate software testing, build evaluation pipelines, and integrate automated checks into CI/CD workflows.
  • Exceptional Communication Skills: Demonstrated ability to collaborate across diverse technical teams, clearly document test strategies, and present findings to both technical and non-technical stakeholders.

Preferred Qualifications

  • Prior hands-on experience in software quality engineering (QE/SDET), AI/ML model validation, or automated testing in a production R&D environment.
  • Familiarity with modern LLM evaluation frameworks and tooling (e.g., DeepEval, RAGAS, LangSmith, PyTest, or custom benchmarking suites).
  • Academic or professional background in mechanical engineering, physics, CAD/CAE, or scientific simulation software.
Inclusion statement
In order to provide equal employment and advancement opportunities to all individuals, employment decisions at 3DS are based on merit, qualifications and abilities. 3DS is committed to a policy of non-discrimination and equal opportunity for all employees and qualified applicants without regard to race, color, religion, gender, sex (including pregnancy, childbirth or medical or common conditions related to pregnancy or childbirth), sexual orientation, gender identity, gender expression, marital status, familial status, national origin, ancestry, age (40 and above), disability, veteran status, military service, application for military service, genetic information, receipt of free medical care, or any other characteristic protected under applicable law. 3DS will make reasonable accommodations for qualified individuals with known disabilities, in accordance with applicable law.
Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable state laws and local ordinances. We are committed to fair employment practices and will evaluate all candidates based on their qualifications, regardless of past arrest or conviction history.
Compensation & Benefits
Dassault Systemes offers an excellent salary with potential for bonus, commensurate with experience. Benefits include a choice of plans providing comprehensive coverage for medical, dental, vision care for employee & dependents as well as employee life, short & long term disability, tuition reimbursement, immediate 401K enrollment, 401K match (50 cents on the dollar, up to the first 8% of your eligible compensation that you contribute based on match eligibility criteria), flexible time off policy, and 10 paid holidays.
Applied = 0

(web-7dc44f465b-kk7p7)