Skip to content
AI Trainer Jobs

Senior AI Trainer

micro1 · 100% remote · Contract · Posted

Pay
$14–36/hr
Location
Northern America and Germany
Languages
English
Hours
Flexible
Openings
50
Level
Experienced
Apply for this position

Summary

Evaluate AI chat and search tools, grade model responses, and test prompts. Use project rubrics to maintain consistent evaluations and submit structured findings for AI training.

What you'll do

  • Evaluate AI chat and search tools under repeatable conditions.
  • Grade, rank, and annotate model responses.
  • Write and test prompts covering varied scenarios and edge cases.
  • Check ratings against evaluation guidelines.
  • Record findings and submit evaluation datasets.
  • Resolve unclear guidance with other contributors.
  • Apply feedback from quality reviews.

Requirements

  • Strong attention to detail and evaluation accuracy.
  • Strong written and verbal communication.
  • Time management and independent remote work skills.
  • Analytical and problem-solving skills.
  • AI training, RLHF, or data labeling experience preferred.
  • Familiarity with AI tools and prompt engineering preferred.
  • Experience writing rubrics or evaluating AI responses preferred.
  • AI training or LLM project background strongly preferred.

Skills

  • Video Annotation
  • Attention to Detail
  • Data Labeling
  • Video Annotation Tools
  • Time Management

Full description

Role Title: Senior AI Trainer


Role Type: Contractor, Remote


Location: Northern America and Germany.


micro1 is engaging Senior AI Trainers to collaborate on a customer-driven project enhancing AI system quality through expert-level model training and evaluation. In this role, you'll apply your generalist expertise and hands-on experience with AI products to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.


Key Responsibilities:

  1. Evaluate the performance of AI chat and search tools under standardized, repeatable conditions.
  2. Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance.
  3. Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents.
  4. Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines.
  5. Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones.
  6. Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
  7. Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards.


Required Skills and Qualifications:

  1. Exceptional attention to detail and accuracy in reviewing and evaluating AI-generated content.
  2. Strong written and verbal communication skills for effective collaboration, reporting, and timely updates on progress and challenges.
  3. Demonstrated time management and self-organization abilities for independent, remote project participation.
  4. Analytical and problem-solving mindset, with a proactive approach to resolving evaluation challenges.


Preferred Qualifications:

  1. Proven experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects.
  2. Familiarity with AI products and tools, including prompt engineering and understanding of model behaviors and limitations.
  3. Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety.
  4. Background in AI training, machine learning data preparation, or LLM-focused projects (strongly preferred).

Similar jobs

View all jobs