Multimodal Image Expert

Mercor · 100% remote · Contract · Posted 4d ago

Pay: $30/hr
Location: Worldwide
Languages: English
Hours: Flexible
Openings: Not listed
Level: Experienced

Summary

Compare pairs of AI-generated images against the prompt, judge quality criteria, and write a rationale for the preferred image.

What you'll do

Compare two AI-generated images side by side
Evaluate prompt alignment and visual quality
Assess anatomy, structure, and rendered text
Select a preferred image or mark both as good or bad
Write a short rationale explaining the choice

Requirements

Have fluent English
Show a sharp eye for visual detail
Explain reasoning clearly in writing

Skills

Visual Analysis
Image Quality Assessment
Prompt Alignment Evaluation
Written Reasoning

Full description

Image SxS Analysis is a project in which expert raters compare pairs of AI-generated images built from the same prompt and select a preferred image, with model identities blinded.

For each task you'll review two images side by side against the original prompt and judge which one is better overall, weighing prompt alignment, visual quality, anatomy and structure, rendered text, and artifacts. You'll pick a preference (or mark both good or both bad) and write a short rationale explaining your choice. Careful, consistent judgment matters more than speed.

You'll start with a paid onboarding quiz ($20, whether you pass or not). Pass it and you move onto project tasks at $30/hr.

Requirements: fluent English, a sharp eye for visual detail, and the ability to explain your reasoning clearly in writing. No specialist degree required.