TL;DR

AI Data Quality Specialist (AI): Develop and evaluate large language models by reviewing and labeling English content for sentiment accuracy, factual consistency, and reasoning quality with an accent on applying structured guidelines and maintaining high annotation standards. Focus on assessing model outputs, validating automated assessments, and ensuring consistent decision-making across high volumes of tasks.

Location: Remote, Philippines

Salary: $4.50 per hour

Company

Welocalize is a company specializing in AI services and language data solutions.

What you will do

  • Review and label content for sentiment, factual accuracy, and reasoning issues.
  • Evaluate model outputs across quality dimensions using scoring frameworks.
  • Validate automated assessments and identify discrepancies or errors.

Requirements

  • Location: Must be based in the Philippines
  • English: Professional-level fluency in reading and writing
  • Previous experience in data annotation or AI training projects.
  • Strong comprehension and ability to articulate written justifications clearly.
  • Exceptional attention to detail and analytical reasoning skills.
  • Familiarity with AI systems or LLM evaluation is a plus.

Culture & Benefits

  • Freelance contract type with remote work flexibility.
  • Opportunity to work on cutting-edge AI data quality projects.
  • Use of AI tools to support the hiring process, with final decisions made by humans.