Senior Code Reviewer for LLM Data Training (Excel)

About Company

SME is a platform that bridges subject-matter experts with AI projects, enabling them to contribute their knowledge to improve AI models. It offers flexible opportunities to work on tasks like data labeling, quality assurance, and domain-specific problem-solving while earning competitive pay.

About the Role

We’re hiring a Code Reviewer with deep Excel expertise to review evaluations completed by data annotators assessing AI-generated Excel code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

• Review and validate annotator assessments of AI-generated Excel formulas, functions, and VBA code.
• Evaluate whether Excel outputs accurately follow prompt instructions and deliver correct results.
• Use your Excel expertise to replicate and test formulas or macros as part of a proof-of-work methodology.
• Identify and correct errors or inconsistencies in annotator evaluations, including misjudged ratings and flawed justifications.
• Provide detailed, constructive feedback to help maintain high annotation quality standards.
• Adhere to the Project Atlas framework for consistent and reliable evaluation practices.

Required Qualifications

• 5–7+ years of hands-on experience in Excel development, spreadsheet QA, or code review.
• Strong command of Excel functions, formulas, data validation, error handling, pivot tables, and possibly VBA scripting.
• Proven ability to debug and test Excel workbooks in diverse scenarios.
• Familiarity with testing or code execution environments relevant to Excel.
• Strong written communication skills and an ability to provide clear, actionable feedback.
• Experience working with structured QA or annotation workflows.
• Proficiency in English (B2 level or above).

Preferred Qualifications

• Experience in AI training, LLM evaluation, or prompt engineering.
• Familiarity with annotation tools or platforms.
• Understanding of RLHF (Reinforcement Learning from Human Feedback) principles and practices.

Compensation

• $15/hour, remote contract position.

Why Join Us?

Join a high-impact team working at the intersection of AI and software development. Your Excel expertise will directly influence the accuracy, safety, and clarity of AI-generated code. This role offers remote flexibility, milestone-based delivery, and competitive compensation.