Skip to content
AI Trainer Jobs
Companies

AI-Assisted Developer Workflows (Trace) AI Task Auditor

Meridial · 100% remote · Contract · Posted

Pay
$60/hr
Location
Worldwide
Languages
English
Hours
Flexible
Openings
Not listed
Level
Expert
Apply for this position

Summary

Audit AI-assisted developer workflow tasks for AI training and evaluation. Check accuracy, reproducibility, and tests, and report IDE integration faults, coding inefficiencies, and logic errors.

What you'll do

  • Assess task accuracy, realism, solvability, and reproducibility.
  • Review supporting tests and evaluation criteria.
  • Identify IDE integration faults and AI-assisted coding inefficiencies.
  • Provide actionable feedback on technical and logic errors.

Requirements

  • Professional experience and deep technical knowledge in modern developer tooling.
  • Expertise in AI coding assistants, telemetry and trace analysis, and developer workflow ecosystems.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Supply a secure computer and high-speed internet.

Skills

  • Developer Tooling
  • AI Coding Assistants
  • Telemetry
  • Trace Analysis
  • IDE Integration
  • Troubleshooting

Full description

roject Overview We are sourcing experienced technical specialists in AI-Assisted Developer Workflows to audit tasks used to train and evaluate AI systems. The objective of this project is to ensure that AI training workflows and tasks are technically rigorous, practical, and highly accurate within your specific area of expertise.

Project Deliverables & Scope

  • Task Evaluation: Assess whether developer workflow tasks are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.

  • Technical Auditing & Feedback: Provide clear, actionable feedback on any identified IDE integration faults, AI-assisted coding inefficiencies, or logic errors within the tasks.

Required Expertise

  • Demonstrable professional experience and deep technical knowledge in modern developer tooling (including AI coding assistants, telemetry/trace analysis, and developer workflow ecosystems). (Note: Candidates will be considered for one specialty based on their experience; expertise across other domains is not required).

  • Strong analytical and problem-solving skills to rigorously test, troubleshoot, and evaluate complex technical scenarios.

We offer a pay rate of $60 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.

 

Employment type: Freelance Contract

Workplace type: Remote

Similar jobs

View all jobs