Skip to content
AI Trainer Jobs
Companies

Crux - Video and Audio QA - English

Welo Data · 100% remote · Contract · Posted

Pay
$28.61/hr
Location
United States
Languages
English
Hours
15-30 hours/week
Openings
Not listed
Level
Experienced

Summary

Audit and re-rate samples of initial ratings for relevance, intent alignment, taxonomy compliance, and linguistic quality. Provide feedback to evaluators and track errors to maintain quality standards.

How the pay compares

This job pays $29 an hour.

  • Generalist jobs: median $60 an hour across 273 open hourly jobs. This job pays $31 less.
  • Welo Data jobs: median $25 an hour across 54 open hourly jobs. This job pays $4 more.

What you'll do

  • Audit samples of initial ratings for relevance, intent alignment, taxonomy compliance, and linguistic quality
  • Re-rate items to verify labels and resolve discrepancies
  • Perform linguistic quality checks and media comprehension reviews
  • Classify and track errors using an agreed taxonomy
  • Provide clear, actionable feedback to evaluators
  • Participate in and lead calibration sessions
  • Track and report QC metrics and meet SLAs
  • Triage escalations and ensure data integrity

Requirements

  • Native or near-native English language proficiency
  • Strong grammar, writing, and proofreading skills
  • Good video and image comprehension, and hearing for audio tasks
  • Solid understanding of search engines and user intent
  • High attention to detail and guideline adherence
  • Ability to deliver clear written feedback and rationale

Skills

  • English Language
  • Proofreading
  • Video Comprehension
  • Audio Comprehension
  • Search Engine Evaluation
  • Quality Assurance

Full description

Overview 

We are hiring Quality Control (QC) evaluators for a project that spans both Search and Linguistic tasks. You will perform quality checks on initial ratings produced by evaluators - validating user intent assessment, query annotation, text classification, and multimedia (video, image, audio) reviews for relevanc, accuracy, and guideline adherence. The ideal candidate combines strong language skills with sharp analytical judgment, excellent documentation and feedback skills, and familiarity with short-form video culture.

What you will do

  • Audit samples of initial ratings for relevance, intent alignment, taxonomy compliance, and linguistic quality.
  • Re-rate items (double-scoring) to verify labels; resolve discrepancies and document decisions.
  • Perform linguistic quality checks (grammar, tone, clarity, local relevance) and media comprehension reviews.
  • Classify and track errors using an agreed error taxonomy; surface trends and edge cases.
  • Provide clear, actionable feedback to evaluators; contribute to guideline clarifications and updates.
  • Participate in and lead calibration sessions to drive inter-rater agreement.
  • Track and report QC metrics (e.g., agreement rates, accuracy, error trends) and meet QC SLAs.
  • Triage escalations, handle ambiguous cases, and ensure data integrity and compliance.
  • Use internal tools to complete, track, and submit QC tasks accurately.

Project Details

    Engagement Type: Freelance  

    Rate: USD 28.61/hour 

    Estimated Hours: 15-30 hours/week  

Requirement

  • Native or near-native speaker level in English language with strong reading, writing, and listening comprehension.
  • Excellent grammar, writing, and proofreading skills.
  • Strong video and image comprehension; good hearing ability for audio tasks.
  • Solid understanding of search engines, user intent, and web content.
  • High attention to detail, consistency, and guideline adherence.
  • Ability to deliver clear written feedback and rationale.

Preferred qualifications

  • Experience in QC/QA for text classification, query annotation, data labeling, or search quality evaluation.
  • Familiarity with short dramas and local short-drama culture/platforms.
  • Experience with calibrations, sampling, scorecards, and root-cause analysis.
  • Comfortable working with productivity and quality targets; proficient with spreadsheets/QA tools.
  • Background in linguistics, communications, media studies, information science, or related field.

Location: United States (remote).

Similar jobs

  • Airline Customer Service SpecialistNew

    Airline Customer Service+13

    $18–28/hr

    🌍 Worldwide

  • Social Media Annotation

    Social Media Annotation+5

    $16–28/hr

    🌍 North America, Europe and Oceania

  • Food Delivery App User Tester

    Food Delivery AppsUS Based+2

    $16–30/hr

    🇺🇸 US

  • Food Delivery AI Response Evaluator

    Food Delivery Domain Knowledge+5

    $10–30/hr

    🌍 Worldwide

View all jobs