Senior Code Reviewer for LLM Data Training (R)

SME Work


Date: 3 weeks ago
City: Remote
Contract type: Contractor
Remote

About Company

SME is a platform that bridges subject-matter experts with AI projects, enabling them to contribute their knowledge to improve AI models. It offers flexible opportunities to work on tasks like data labeling, quality assurance, and domain-specific problem-solving while earning competitive pay.

About the Role

We’re hiring a Code Reviewer with deep R expertise to review evaluations completed by data annotators assessing AI-generated R code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

  • Review and audit annotator evaluations of AI-generated R code.
  • Assess if the R code follows the prompt instructions, is functionally correct, and secure.
  • Validate code snippets using proof-of-work methodology.
  • Identify inaccuracies in annotator ratings or explanations.
  • Provide constructive feedback to maintain high annotation standards.
  • Work within Project Atlas guidelines for evaluation integrity and consistency.

Required Qualifications

  • 5–7+ years of experience in R development, QA, or code review.
  • Strong knowledge of R syntax, debugging, edge cases, and testing.
  • Comfortable using code execution environments and testing tools.
  • Excellent written communication and documentation skills.
  • Experience working with structured QA or annotation workflows.
  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications

  • Experience in AI training, LLM evaluation, or model alignment.
  • Familiarity with annotation platforms.
  • Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.

Compensation:

  • $22 Hourly



Why Join Us?

Join a high-impact team working at the intersection of AI and software development. Your R expertise will directly influence the accuracy, safety, and clarity of AI-generated code. This role offers remote flexibility, milestone-based delivery, and competitive compensation.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

System Engineering Intern

Siemens, Remote
3 days ago
Are you ready to embark on a transformative internship experience with Siemens, a global leader in technology and innovation? Join us and collaborate with industry experts, gain hands-on experience, and contribute to cutting-edge projects that make a difference. As a Siemens intern, you'll have the chance to develop and refine essential skills while impacting our customers' initiatives and business drivers.You’ll...

Senior Data Architect

WRS Health, Remote
4 days ago
Company OverviewVoted #1 EHR by PC Mag, WRS Health delivers a fully integrated cloud based EMR and practice management solutions to its clients. We bring solutions to physicians by providing constant enhancement of our products and services including EHR, practice management, marketing, patient coordination and billing.Job Purpose and RoleWRS Health is seeking  a hands-on and strategic Director of Data Architecture...

Enterprise Sales Director

Zycus, Remote
1 week ago
The Regional Sales Director will be responsible for driving sales efforts in Thailand & Philippines. As our Regional Sales Director for the region, you will drive new customer acquisitions and will be hunting new logos by developing key growth sales strategies, tactics and action plans. This is an individual contributor role and will be responsible for hitting the sales quota...