AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start

Responsibilities

About the Team

Generative AI and large language models are reshaping the core capabilities of global content platforms — and high-quality training and evaluation data is one of the key factors that determines a model's ceiling.

We are the AI Data Service & Operations (ADSO) team behind TikTok's international products, responsible for producing multilingual, multimodal data assets across both safety and non-safety domains. The standards we set and the data we deliver power two critical fronts: TikTok's global content ecosystem governance strategy on one side, and the training and evaluation pipelines for AI / large language models on the other. In short, we produce the fuel that helps models truly understand content, communities, and users around the world.

Role Summary

We are looking for an AI Model Evaluation & Quality Strategy Specialist to help define what high-quality data means for large model training and evaluation. This role focuses on quality standards, judgment rules, complex case assessment, issue correction, and feedback loops that improve AI model evaluation outcomes across markets.

We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth.

Successful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.

Candidates can apply to a maximum of two positions and will be considered for jobs in the order you apply. The application limit is applicable to our Company and its affiliates' jobs globally. Applications will be reviewed on a rolling basis - we encourage you to apply early.

Key Responsibilities

• Participate in defining and continuously improving data quality standards, judgment rules, and acceptance criteria for large model training and evaluation scenarios.
• Review data outputs against quality standards, identify issues, drive correction loops, and ensure accuracy and consistency.
• Assess complex, ambiguous, and boundary cases, and turn decisions into reusable judgment rules and knowledge assets.
• Track quality performance, analyze root causes, and recommend improvements to production-side workflows and execution.
• Work with production, product, algorithm, strategy, and quality teams to align standards across the full chain from standard-setting to production, acceptance, and feedback.
  
  

Qualifications

Minimum Qualifications

• Individuals who are completing or have recently completed a Bachelor's degree in law, philosophy, economics, journalism, languages, social sciences, data, or related fields are welcome.
• Internship or project experience in data quality, content review, compliance, content operations, AI data, annotation, policy, or quality evaluation is preferred.
• Excellent English listening, speaking, reading, and writing skills, with the ability to accurately understand English video and text content.
• Familiar with Excel or other common data processing tools; deep hands-on use of ChatGPT, Claude, Gemini or similar large model products is preferred.
• Strong structured thinking, abstraction, judgment, and communication skills; detail-oriented and able to explain what high-quality data means in ambiguous cases.
  
  

Job Information

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.