Senior Code Reviewer for LLM Data Training (R)

SME Work


Date: 1 day ago
City: Remote
Contract type: Contractor
Remote

About Company

SME is a platform that bridges subject-matter experts with AI projects, enabling them to contribute their knowledge to improve AI models. It offers flexible opportunities to work on tasks like data labeling, quality assurance, and domain-specific problem-solving while earning competitive pay.

About the Role

We’re hiring a Code Reviewer with deep R expertise to review evaluations completed by data annotators assessing AI-generated R code responses. Your role is to ensure that annotators follow strict quality guidelines related to instruction-following, factual correctness, and code functionality.

Responsibilities

  • Review and audit annotator evaluations of AI-generated R code.
  • Assess if the R code follows the prompt instructions, is functionally correct, and secure.
  • Validate code snippets using proof-of-work methodology.
  • Identify inaccuracies in annotator ratings or explanations.
  • Provide constructive feedback to maintain high annotation standards.
  • Work within Project Atlas guidelines for evaluation integrity and consistency.

Required Qualifications

  • 5–7+ years of experience in R development, QA, or code review.
  • Strong knowledge of R syntax, debugging, edge cases, and testing.
  • Comfortable using code execution environments and testing tools.
  • Excellent written communication and documentation skills.
  • Experience working with structured QA or annotation workflows.
  • English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications

  • Experience in AI training, LLM evaluation, or model alignment.
  • Familiarity with annotation platforms.
  • Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.

Compensation:

  • $22 Hourly



Why Join Us?

Join a high-impact team working at the intersection of AI and software development. Your R expertise will directly influence the accuracy, safety, and clarity of AI-generated code. This role offers remote flexibility, milestone-based delivery, and competitive compensation.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Ads Quality Evaluator-Hindi

Cognizant, Remote
6 days ago
Cognizant is looking for a Process Executive Hindi (Content Moderator) in developing customized product for our clients. The role is expected to drive technology discussions and analyze the current landscape for gaps in addressing business needs. Cognizant needs a motivated individual to challenge the status quo and provide thought leadership/best practices to enhance our current services and technologies.Job Title: Process...

Affiliate Relationship Manager

Binance, Remote
1 week ago
Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by over 250 million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments,...

Interpreter

DataAnnotation, Remote
1 week ago
DataAnnotation is committed to creating quality AI. Join our team to help train AI chatbots while gaining the flexibility of remote work and choosing your own schedule.We are looking for a bilingual professional to join our team and teach AI chatbots. You will have conversations in both Malay and English with chatbots in order to measure their progress, as well...