Portuguese AI Evaluation Specialist (Brazil)
Handshake AI · 100% remote · Contract · Posted
- Pay
- $25/hr
- Location
- Brazil
- Languages
- Portuguese, English
- Hours
- Flexible
- Openings
- Not listed
- Level
- Experienced
Summary
Evaluate and rank AI-generated responses in Portuguese, providing written feedback to improve personalization.
How the pay compares
This job pays $25 an hour.
- Languages jobs: median $36 an hour across 515 open hourly jobs. This job pays $11 less.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $55 less.
What you'll do
- Complete tasks on the annotation platform using real-world AI tool experience
- Compare and evaluate AI-generated responses, sharing preferences and reasoning
- Provide clear written feedback to help AI personalize responses
- Work at own pace with no set schedule or minimum hours
Requirements
- Be based in Brazil
- Be fluent in Portuguese (written and spoken)
- Have B2-level English proficiency
- Have a Bachelor's degree or higher
- Work independently in a remote, asynchronous environment
- Have real-world experience with AI tools
- Be comfortable forming and defending preferences between AI responses
Skills
- AI Tools
- Data Annotation
- Written Communication
Full description
Opportunity Overview
Handshake is looking for Portuguese speakers based in Brazil to help make AI responses more personalized. This is not a traditional job - you'll use your Portuguese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
- Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
- Provide clear written feedback that helps AI better understand and personalize responses for individual users
- Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
- Location - Based in Brazil and able to work remotely in an asynchronous, self-directed capacity
- Language - Fluent in Portuguese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English.
- Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
- Must have a Bachelor's degree or higher
- Strong written communication in Portuguese and English at B-2 level proficiency
- Ability to work independently in a remote, asynchronous environment
Degree: Bachelor's
Similar jobs
AI Trainer - Advanced Indonesian FluencyIndonesianEnglishSentiment AnalysisAudio AssessmentLinguistic NuanceEmotional Intelligence+4$24/hr
🇮🇩 Indonesia
Traditional Chinese Content ReviewerTraditional Chinese WritingLocalizationContent EditingSummarizationFact-CheckingResearch+6$24/hr
🇹🇼 Taiwan
Spanish AI Evaluation Specialist (Mexico)SpanishEnglishAI Tools+0$25/hr
🇲🇽 Mexico
Spanish AI Evaluation Specialist (Mexico)ChatGPTSpanishAI Evaluation+1$25/hr
🇲🇽 Mexico