Chemicals Safety for Redteaming
Mercor · 100% remote · Contract · Posted
- Pay
- $65–75/task
- Location
- Worldwide
- Languages
- English
- Hours
- Flexible
- Openings
- Not listed
- Level
- Expert
Summary
Write challenging chemistry prompts across benign, dual-use, and adversarial levels, evaluate AI model responses against policy standards, and provide reference answers with technical reasoning.
What you'll do
- Write challenging single-turn prompts in chemistry
- Label prompts as benign, dual-use, or adversarial
- Evaluate model responses against a defined policy standard
- Judge whether each response was handled correctly
- Write reference answers with technical reasoning
Requirements
- Have hands-on experience in synthesis, analytical chemistry, or chemical safety
- Provide a sample or link to prior technical writing or published research
- Write clear technical rationales that non-specialists can follow
- Prior AI red-teaming or model evaluation experience is preferred but not required
Skills
- Chemistry
- Synthesis
- Analytical Chemistry
- Chemical Safety
- Process Safety
- Technical Writing
Full description
About the work
Mercor is assembling a panel of chemistry domain experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request; answering legitimate questions fully while refusing genuinely dangerous ones.
You will:
Write challenging single-turn prompts in your domain, labelled across three levels: benign, dual-use, and adversarial.
Evaluate the responses that come back against a defined policy standard, and judge whether each was handled correctly.
Write the reference answer — what a correct response looks like, and the technical reasoning for why.
The hard part is calibration, not difficulty. A benign prompt that a model wrongly refuses is as valuable as an adversarial one it wrongly answers. That judgment is why we need domain experts rather than generalists — in chemistry the line sits between mechanism and procedure, and only someone who has run the reaction knows exactly where it falls. Background we're looking for
We're looking for professionals with hands-on experience in synthesis, analytical chemistry, or chemical safety. Prior AI evaluation or red-teaming experience is preferred. Relevant backgrounds include:
Chemical Defense Researcher (USAMRICD, DoD, CDC) — toxicological agents and medical countermeasures.
Synthetic / Process Chemist — route design, reaction engineering and scale-up.
Analytical Chemist — detection and identification methods for hazardous compounds.
Industrial Hygienist / Process Safety Engineer — exposure assessment, toxic release and process hazard analysis.
Forensic / Toxicological Chemist — controlled substances, precursor identification and casework.
What this role demands beyond technical depth
This is writing-intensive work. Every judgment you make needs a written rationale that a non-specialist can follow. Prior technical writing, published research, or expert witness experience is a strong signal — please include a sample or link.
Prior AI red-teaming or model evaluation experience is a plus but not required.
You will also be reading and writing about misuse scenarios in your field for sustained periods. We brief experts on this in advance, and you can pause or step away at any point without penalty.
Before you apply
Your work here will not involve, and must not draw on, classified or export-controlled information, or anything covered by an NDA or prepublication review obligation. If you hold such obligations you may still be a good fit — tell us in your application and we will scope the work accordingly.
Similar jobs
Mathematics ExpertMathematicsProof VerificationMathematical ReasoningAI Model Evaluation+3$40–75/hr
🌍 Worldwide
Forensic / Toxicological ChemistForensic ChemistryToxicologyControlled Substance AnalysisPrecursor IdentificationTechnical WritingExpert Testimony+5$65–75/task
🌍 Worldwide
Industrial Hygienist / Process Safety EngineerIndustrial HygieneProcess Hazard AnalysisHAZOPLOPAToxic Release ModelingTechnical Writing+7$65–75/task
🌍 Worldwide
Analytical ChemistGC-MSLC-MS/MSIRNMRMethod DevelopmentTrace-Level Analysis+5$65–75/task
🌍 Worldwide