Domain Expert, AI Evaluation (US)
Handshake AI · 100% remote · Contract · Posted
- Pay
- $200/hr
- Location
- United States
- Languages
- English
- Hours
- 5-20 hours per week
- Openings
- Not listed
- Level
- Expert
Summary
Write and solve challenging problems in your STEM field, develop domain-specific prompts, and evaluate AI responses for correctness and reasoning quality. Research topics with AI assistance in a remote, asynchronous setting.
How the pay compares
This job pays $200 an hour.
- STEM jobs: median $60 an hour across 370 open hourly jobs. This job pays $140 more.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $120 more.
What you'll do
- Write and solve challenging problems in your area of expertise
- Develop domain-specific prompts
- Evaluate LLM responses for correctness and quality of reasoning
- Research topics with AI assistance
Requirements
- Be based in the United States with US work authorization
- Work independently in a remote, asynchronous environment
- Commit approximately 5 to 20 hours per week
- Hold a Master's degree with relevant experience or a PhD (including current students and postdocs)
- Have 2+ years of research or industry experience in your field
- Demonstrate deep subject knowledge and attention to detail
- Possess strong written communication skills
Skills
- Mathematics
- Chemistry
- Biology
- Physics
- Engineering
- Computer Science
- Medicine
Full description
Overview
Handshake is recruiting exceptional STEM Master's and PhD holders residing in the United States to partner with leading AI labs and join our AI research community. This program brings subject-matter experts together to enhance the capabilities of Large Language Models (LLMs) across specialized scientific and technical domains. The Handshake AI Fellowship program runs year-round, though project availability will vary by discipline.
Details
The position is remote and asynchronous - work independently from wherever you are.
Flexible hours and the ability to work remotely, with a commitment of approximately 5 to 20 hours per week.
Project work includes, but is not limited to, writing and solving challenging problems in your area of expertise, developing domain-specific prompts and evaluating LLM responses for correctness and quality of reasoning.
Dedicate time researching topics that are interesting to you, with the assistance of AI.
Learn new skills while contributing to the changing world of AI across various disciplines.
Placement into a project will be dependent on project availability. You'll apply once and, if qualified, be considered for projects as they open.
Qualifications
Education: PhD students and graduates (including those currently enrolled in a PhD program or in postdoctoral positions), or Master’s degree holders with relevant experience, in Mathematics, Chemistry, Biology, Physics, Engineering, Computer Science, Medicine, etc.
Experience: 2+ years of research or industry experience in your field, in addition to your degree
Subject expertise: Deep subject knowledge and careful attention to detail, and confidence that your domain expertise can outmatch current AI systems in understanding and explaining key concepts in your field
Written communication: Strong written communication, with the ability to translate complex research knowledge into clear, structured task instructions and evaluation criteria
Required for all applicants
Must be based in the United States and have US work authorization
Ability to work independently in a remote, asynchronous environment
Availability of approximately 5 to 20 hours per week
Degree: Master's
Similar jobs
Aerospace Engineering ExpertTechnical Depth in a SubdomainEngineering Judgment Under ConstraintsKnowing When an Answer Is WrongAerodynamicsPropulsionStructures+5$85–185/hr
🌍 Worldwide
Engineering LeadElectrical EngineeringMechanical EngineeringCivil EngineeringStructural EngineeringChemical EngineeringAerospace Engineering+7$195/hr
🇺🇸 US
Nuclear ProfessionalNuclear EngineeringNuclear ScienceTechnical EvaluationFeedback Delivery+3$300/hr
🌍 Worldwide
Computational Biologists (Wet Lab): Building Research Tasks for AI TrainingBioinformaticsGenomicsExperimental BiologyExperimental Protocol DesignBiological Data Analysis+3$500
🌍 Worldwide