TL;DR

AI Safety Evaluator (AI): Evaluating AI-generated responses for appropriateness, safety, and reliability within the target locale’s cultural context. Focus on applying a structured safety rubric to assess AI-generated responses for appropriateness, safety, and reliability within the target locale’s cultural context.

Location: Remote – Singapore

Salary: 28 USD per hour

Company

Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems.

What you will do

  • Evaluate AI-generated responses using a structured safety rubric.
  • Complete two independent evaluations per item.
  • Provide concise, well-structured rationales in English.
  • Participate in calibration sessions and support arbitration when evaluation discrepancies occur.
  • Maintain quality and throughput targets during the evaluation window.

Requirements

  • Fluency in the target language (Tamil) and English.
  • Deep cultural understanding of the target locale.
  • Strong written English skills for documentation and rationales.
  • Prior experience in safety evaluation, policy review, content moderation, or rubric-based assessment preferred.
  • Ability to apply detailed guidelines consistently.
  • Comfortable working with explicit and sensitive content in a professional capacity.

Culture & Benefits

  • Project-based opportunities that fit your availability with complete autonomy.
  • Optional access to AI and Large Language Model workshops.
  • Be part of a global contributor community with responsive guidance and support.