AI Safety & Evaluation Specialist
micro1 · 100% remote · Contract · Posted
- Pay
- $30–50/hr
- Location
- United States
- Languages
- English
- Hours
- Part-time, project-based
- Openings
- 50
- Level
- Experienced
Summary
Test AI agents for privacy violations, review responses for sensitive data disclosures, and document findings using privacy expertise.
How the pay compares
At the middle of its range, this job pays $40 an hour.
What you'll do
- Test AI agents using privacy-focused scenarios.
- Review AI-generated responses for inappropriate disclosures of personal or sensitive information.
- Identify privacy risks and potential data-protection violations.
- Document findings and provide clear, evidence-based feedback.
- Apply privacy principles to evaluate complex or ambiguous cases.
Requirements
- Professional experience in privacy, data protection, or related fields.
- Strong understanding of privacy risks and sensitive data handling.
- Analytical skills, attention to detail, and clear written communication.
- Experience evaluating LLMs or AI-generated content.
- Familiarity with AI agents and AI privacy or safety evaluations.
Skills
- Privacy Risk Assessment
- Data Protection
- AI Evaluation
- Analytical Skills
- Written Communication
Full description
Role type: Contractor
Location: United States
Commitment: Part-time, project-based
Duration: 6 weeks
Compensation: $30–$60 USD/hour
About the opportunity
micro1 is looking for privacy and data-protection professionals to evaluate how personal AI agents handle sensitive information.
You'll test AI agents, review their responses, and identify potential privacy violations or inappropriate disclosures. This role is ideal for professionals interested in applying their privacy expertise to AI evaluation.
What you'll do
- Test AI agents using privacy-focused scenarios.
- Review AI-generated responses for inappropriate disclosures of personal or sensitive information.
- Identify privacy risks and potential data-protection violations.
- Document findings and provide clear, evidence-based feedback.
- Apply privacy principles to evaluate complex or ambiguous cases.
What we're looking for
Required qualifications
- Professional experience in privacy, data protection, or related fields.
- Strong understanding of privacy risks and sensitive data handling.
- Analytical skills, attention to detail, and clear written communication.
- Based in the United States.
Preferred qualifications
- Experience evaluating LLMs or AI-generated content.
- Familiarity with AI agents and AI privacy or safety evaluations.
Application process
Candidates will complete an AI interview after applying. No additional assessments are required.
About micro1
micro1 is a data lab that connects professionals with opportunities to apply their expertise to customer projects. We work with specialists across fields such as engineering, finance, healthcare, and law to support AI labs and enterprises. Through our extended network, contributors bring their knowledge and judgment to projects with their own scope, requirements, and engagement terms.
Similar jobs
Legal Annotators - DutchLegal InterpretationContract ReviewData AnnotationMachine Learning Data EvaluationQuality Assurance+4$36.45/hr
🌍 Worldwide
Legal Specialist (Microsoft Office User)Microsoft Office SuiteMicrosoft TeamsAI TrainingLitigationContract Drafting+4$25–40/hr
🌍 Worldwide
Data Privacy SpecialistData PrivacyData ProtectionInformation GovernancePrivacy Risk AssessmentPrivacy PrinciplesSensitive Data Handling+11$30–60/hr
🇺🇸 US
Senior Claims Investigation and Evidence Review ExpertSpecial Investigations and Staged-LossFraud Detection From Claim Evidence+1$20–60/hr
🌍 Worldwide