Overview

Remote, full-time AI/ML data operations role supporting LLM training pipelines from Brazil. You will deliver high-quality annotations, evaluations, and QA using clear rubrics and strict guideline compliance.

What You Will Do

• Perform AI data annotation and data labeling for LLM training datasets
• Complete RLHF preference ranking, prompt evaluation, and QA evaluation tasks using consistent rubrics
• Improve training data quality by reducing label noise and documenting edge cases
• Execute NLP tasks such as named entity recognition and classification
• Support computer vision annotation (bounding boxes, polygons, segmentation) when needed
• Handle content safety labeling aligned to policy/risk taxonomies
• Collaborate with engineering/ops on error analysis and rubric updates

Required Qualifications

• Mid-Senior experience in annotation, LLM evaluation, or data la...