Spanish AI Evaluation Specialist (Mexico)
Handshake AI · 100% remote · Contract · Posted
- Pay
- $25/hr
- Location
- Mexico
- Languages
- Spanish
- Hours
- Flexible
- Openings
- Not listed
- Level
- Experienced
Summary
Evaluate and rank AI-generated responses using personal experience with ChatGPT, and provide written feedback in Spanish to improve personalization.
How the pay compares
This job pays $25 an hour.
- Languages jobs: median $36 an hour across 515 open hourly jobs. This job pays $11 less.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $55 less.
What you'll do
- Complete tasks on the annotation platform
- Compare and evaluate AI-generated responses
- Share honest preferences and reasoning
- Provide clear written feedback
Requirements
- Be based in Mexico
- Speak fluent Spanish
- Have prior hands-on experience with ChatGPT
- Be comfortable forming and defending preferences
- Be willing to share ChatGPT conversation history
- Have strong written communication in Spanish
- Work independently in a remote asynchronous environment
- Hold a Bachelor's degree
Skills
- ChatGPT
- Spanish
- Written Communication
- AI Evaluation
- Critical Thinking
Full description
Job description
Opportunity Overview
Handshake is looking for Spanish-speakers based in Mexico to help make AI responses more personalized. This is not a traditional job - you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
Provide clear written feedback that helps AI better understand and personalize responses for individual users
Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
Location - Based in Mexico and able to work remotely in an asynchronous, self-directed capacity
Language - Fluent in Spanish, both written and spoken, with strong written communication skills for explaining your reasoning clearly
AI experience - Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another
Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially)
Strong written communication in Spanish
Ability to work independently in a remote, asynchronous environment
Degree: Bachelor's
Similar jobs
Portuguese AI Evaluation Specialist (Brazil)AI ToolsData Annotation+0$25/hr
🇧🇷 Brazil
Spanish AI Evaluation Specialist (Mexico)SpanishEnglishAI Tools+0$25/hr
🇲🇽 Mexico
Audiobook QA Expert — English (US)Audio QAAnnotationLinguisticsProofreadingTranscription+3$20–25/hr
🌍 Worldwide
Maps Personalization Quality Reviewer - JapaneseQuality AssuranceContent EvaluationGoogle SheetsLocal SearchPersonalization+4$25/hr
🇯🇵 Japan