AI Quality Engineer

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering, as we are hiring a AI Quality Engineer in Kuala Lumpur, Malaysia!

We are building a virtual companion for Operation Planning & Optimization applications that can reason, retrieve, and act autonomously. Powered by large language models (LLMs) and agentic workflows, the product will redefine how our customers interact with complex planning data. As an AI Engineer you will architect the intelligence, shape model behavior, and ensure safety and reliability at scale.

Role Responsibilities & Job Description:

• Prompt Engineering & Evaluation: Design and execute sophisticated test cases using prompt injection and adversarial testing to evaluate the AI’s boundaries and responses.
• LLM Benchmarking: Utilize advanced frameworks to measure performance in critical areas like hallucination rates, sentiment consistency, and context retention.
• Automated Validation: Build and maintain automated pipelines that leverage "LLM-as-a-judge" patterns to evaluate model outputs at scale.
• Safety & Bias Auditing: Lead "Red Teaming" sessions to identify potential biases, toxic content, or PII (Personally Identifiable Information) leaks.
• Regression Testing: Manage the evaluation of model performance across different versions to ensure seamless upgrades and stability.
• Collaboration & Delivery: Work with Product Owner, Developers, AI Engineers and UX Designers to deliver the Virtual Companion. Contribute to sprint planning, code reviews and documentation.
  
  

Requirements & Qualifications:

Technical Requirements:

• AI/ML Literacy: A strong grasp of LLM fundamentals, including tokens, temperature, top-p, and context windows.
• Programming: Proficiency in Python.
• API Testing: Expertise in testing RESTful APIs and WebSocket connections for real-time AI interactions.
  
  

Preferred Qualifications:

• Bachelor’s degree or above, with 3-5 years in software development and relevant experience specifically within the AI/ML testing landscape.
• Strong analytical and problem-solving skills
• Excellent people skills with collaborative attitude, team player
• Excellent communication skills and a good command of English
• A proactive mindset toward identifying "edge case" behaviors in generative models.
  
  

What's in it for you?

• You will be working at the intersection of Software Engineering, Data Science, and Ethics. You will play a pivotal role in defining what "quality" means for the next generation of Virtual Companions, helping us build AI that users can trust and enjoy.
• Impact: Directly shape a product that will be used by global supply chain leaders.
• Innovation: Work at the intersection of Generative AI, agentic systems, and real world optimization.
• Culture: Collaborative, ethically driven, and inclusive environment.
• Growth: Dedicated learning budget, hands‑on exposure to real‑world supply‑chain challenges, clear career pathways
  
  

Inclusion statement

As a game-changer in sustainable technology and innovation, Dassault Systèmes is striving to build more inclusive and diverse teams across the globe. We believe that our people are our number one asset and we want all employees to feel empowered to bring their whole selves to work every day. It is our goal that our people feel a sense of pride and a passion for belonging. As a company leading change, it’s our responsibility to foster opportunities for all people to participate in a harmonized Workforce of the Future.