Data Analyst (AI Evaluation)
micro1 · 100% remote · Contract · Posted
- Pay
- $30–60/hr
- Location
- United States
- Languages
- English
- Hours
- Flexible
- Openings
- 30
- Level
- Experienced
Summary
Review datasets and task outputs for accuracy, completeness, and adherence to guidelines. Identify inconsistencies and apply structured rubrics to help train AI systems.
How the pay compares
At the middle of its range, this job pays $45 an hour.
What you'll do
- Review datasets and detailed task outputs
- Identify and flag inconsistencies and errors
- Apply structured rubrics and evaluation criteria
- Exercise sound judgment and document rationale
- Escalate recurring data issues
- Provide clear, actionable feedback
- Maintain meticulous attention to detail
Requirements
- 3–5+ years of experience in data review or quality assurance
- Proven expertise in reviewing and critiquing data based on explicit criteria
- Ability to follow detailed written instructions and apply complex rubrics
- Comfort with ambiguity and making justifiable decisions
- Advanced attention to detail and error-spotting
- Strong written and verbal communication skills
- Baseline fluency with spreadsheets (sorting, filtering, simple formulas)
Skills
- Data Analysis
- Data Review
- Attention to Detail
- Handling Ambiguity
- Error Spotting
Full description
Role Title: Data Analyst (AI Evaluation)
Role Type: Contractor
Location: Remote, US-based.
micro1 is engaging Data Analysts to contribute their knowledge and expertise to a customer’s data quality project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Review datasets and detailed task outputs for accuracy, completeness, and adherence to guidelines.
- Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions.
- Apply structured rubrics and evaluation criteria consistently across large data sets.
- Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear.
- Escalate patterns or recurring data issues for further analysis rather than addressing them individually.
- Provide clear, actionable written and verbal feedback pinpointing issues and suggesting resolution paths.
- Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments.
Preferred Qualifications
- 3–5+ years of experience in data review, data quality, quality assurance, or analytical roles.
- Proven expertise in reviewing, validating, and critiquing data or deliverables based on explicit criteria.
- Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely.
- Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete.
- Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work.
- Strong written and verbal communication skills for documenting findings and providing feedback.
- Baseline fluency with spreadsheets (sorting, filtering, simple formulas); SQL or hands-on data querying is a plus.
- Experience with data annotation, labeling, or rubric-based evaluation is advantageous.
Similar jobs
Mobility Equipment / Automotive Electrical Technician (Wheelchair Vans)Automotive 12V Electrical Diagnostics From Wiring DiagramsMobility Conversion Systems (Lifts - Ramps - Kneeling - Hand Controls)Service Procedures and Technician Training+2$20–60/hr
🌍 Worldwide
Semiconductor Yield / Defect Engineer (Wafer Fab, SEM Defect Review)SEM Defect Review and ClassificationYield Analysis and Excursion / Lot-Hold DecisionsWafer Sort and Test Floor Data+2$20–60/hr
🌍 Worldwide
Senior Flight Operations ExpertInstrument Approach Plate and Procedure BriefingFlight Planning and Operational Documentation ReviewRegulatory Operations Compliance (Part 121 - 135 - ICAO)+2$20–60/hr
🌍 Worldwide
Senior Technical Documentation, Parts and Annotation SpecialistAssembly Manual Authoring From Engineering Drawings and BOMsIndustrial Parts Identification and Fitment Quoting From Photos and CatalogsProduction Pattern and Marker InterpretationImage Annotation QA+3$20–60/hr
🌍 Worldwide