Spanish AI Evaluation Specialist (Mexico)
Handshake AI · 100% remote · Contract · Posted
- Pay
- $25/hr
- Location
- Mexico
- Languages
- Spanish, English
- Hours
- Flexible
- Openings
- Not listed
- Level
- Entry level
Summary
Evaluate and rank AI-generated responses in Spanish, providing written feedback to improve personalization. Use real-world experience with AI tools and work asynchronously.
How the pay compares
This job pays $25 an hour.
- Languages jobs: median $36 an hour across 515 open hourly jobs. This job pays $11 less.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $55 less.
What you'll do
- Complete annotation tasks using real-world experience with AI tools
- Compare and evaluate AI-generated responses
- Share honest preferences and reasoning for evaluations
- Provide clear written feedback to help AI personalize responses
- Work at your own pace without schedule requirements
Requirements
- Hold a Bachelor's degree or higher
- Speak and write fluently in Spanish
- Read and write English at B2 level or higher
- Communicate clearly in writing in Spanish and English
- Work independently in a remote, asynchronous environment
- Form and defend preferences between AI responses
Skills
- Spanish
- English
- Written Communication
- Critical Thinking
- AI Tools
Full description
Opportunity Overview
Handshake is looking for Spanish speakers based in Mexico to help make AI responses more personalized. This is not a traditional job - you'll use your Spanish language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
- Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
- Provide clear written feedback that helps AI better understand and personalize responses for individual users
- Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
- Location - Based in Mexico and able to work remotely in an asynchronous, self-directed capacity
- Language - Fluent in Spanish, both written and spoken, with strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English.
- Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
- Must have a Bachelor's degree or higher
- Strong written communication in Spanish and English at B-2 level proficiency
- Ability to work independently in a remote, asynchronous environment
Degree: Bachelor's
Similar jobs
Traditional Chinese Content ReviewerTraditional Chinese WritingLocalizationContent EditingSummarizationFact-CheckingResearch+6$24/hr
🇹🇼 Taiwan
Portuguese AI Evaluation Specialist (Brazil)AI ToolsData Annotation+0$25/hr
🇧🇷 Brazil
Spanish AI Evaluation Specialist (Mexico)ChatGPTSpanishAI Evaluation+1$25/hr
🇲🇽 Mexico
Audiobook QA Expert — English (US)Audio QAAnnotationLinguisticsProofreadingTranscription+3$20–25/hr
🌍 Worldwide