Skip to content
AI Trainer Jobs
Companies

Domain Expert, AI Evaluation (US)

Handshake AI · 100% remote · Contract · Posted

Pay
$200/hr
Location
United States
Languages
English
Hours
5-20 hours per week
Openings
Not listed
Level
Expert

Summary

Write and solve challenging problems in your STEM field, develop domain-specific prompts, and evaluate AI responses for correctness and reasoning quality. Research topics with AI assistance in a remote, asynchronous setting.

How the pay compares

This job pays $200 an hour.

  • STEM jobs: median $60 an hour across 370 open hourly jobs. This job pays $140 more.
  • Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $120 more.

What you'll do

  • Write and solve challenging problems in your area of expertise
  • Develop domain-specific prompts
  • Evaluate LLM responses for correctness and quality of reasoning
  • Research topics with AI assistance

Requirements

  • Be based in the United States with US work authorization
  • Work independently in a remote, asynchronous environment
  • Commit approximately 5 to 20 hours per week
  • Hold a Master's degree with relevant experience or a PhD (including current students and postdocs)
  • Have 2+ years of research or industry experience in your field
  • Demonstrate deep subject knowledge and attention to detail
  • Possess strong written communication skills

Skills

  • Mathematics
  • Chemistry
  • Biology
  • Physics
  • Engineering
  • Computer Science
  • Medicine

Full description

Overview

Handshake is recruiting exceptional STEM Master's and PhD holders residing in the United States to partner with leading AI labs and join our AI research community. This program brings subject-matter experts together to enhance the capabilities of Large Language Models (LLMs) across specialized scientific and technical domains. The Handshake AI Fellowship program runs year-round, though project availability will vary by discipline.

Details

The position is remote and asynchronous - work independently from wherever you are.
Flexible hours and the ability to work remotely, with a commitment of approximately 5 to 20 hours per week.
Project work includes, but is not limited to, writing and solving challenging problems in your area of expertise, developing domain-specific prompts and evaluating LLM responses for correctness and quality of reasoning.
Dedicate time researching topics that are interesting to you, with the assistance of AI.
Learn new skills while contributing to the changing world of AI across various disciplines.
Placement into a project will be dependent on project availability. You'll apply once and, if qualified, be considered for projects as they open.

Qualifications

Education: PhD students and graduates (including those currently enrolled in a PhD program or in postdoctoral positions), or Master’s degree holders with relevant experience, in Mathematics, Chemistry, Biology, Physics, Engineering, Computer Science, Medicine, etc.
Experience: 2+ years of research or industry experience in your field, in addition to your degree
Subject expertise: Deep subject knowledge and careful attention to detail, and confidence that your domain expertise can outmatch current AI systems in understanding and explaining key concepts in your field
Written communication: Strong written communication, with the ability to translate complex research knowledge into clear, structured task instructions and evaluation criteria

Required for all applicants

Must be based in the United States and have US work authorization
Ability to work independently in a remote, asynchronous environment
Availability of approximately 5 to 20 hours per week

Degree: Master's

Similar jobs

View all jobs