Mandarin AI Evaluation Specialist (Singaporean Dialect)
Handshake AI Β· 100% remote Β· Contract Β· Posted
- Pay
- $30/hr
- Location
- Worldwide
- Languages
- Mandarin (Singaporean), English
- Hours
- Flexible
- Openings
- Not listed
- Level
- Entry level
Summary
Evaluate and rank AI-generated responses based on personal preference and reasoning. Provide clear written feedback in Singaporean Mandarin and English to help AI models better tailor answers to individual users.
How the pay compares
This job pays $30 an hour.
- Languages jobs: median $36 an hour across 515 open hourly jobs. This job pays $6 less.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $50 less.
What you'll do
- Complete tasks on the annotation platform using real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing honest preferences and reasoning
- Provide clear written feedback that helps AI personalize responses
- Complete tasks at your own pace without a set schedule
Requirements
- Be fluent in Mandarin as used in Singapore, both written and spoken
- Have B2-level English proficiency or higher
- Have strong written communication in both Mandarin and English
- Hold a Bachelor's degree or higher
- Be comfortable forming and defending preferences between AI responses
- Work independently in a remote, asynchronous environment
Skills
- Mandarin (Singaporean)
- English (B2)
- Written Communication
- AI Response Evaluation
- Critical Thinking
Full description
Opportunity Overview
Handshake is looking for Mandarin speakers familiar with the Singaporean-Mandarin dialect to help make AI responses more personalized. This is not a traditional job - you'll use your language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users. No prior AI training experience is required.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
- Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
- Provide clear written feedback that helps AI better understand and personalize responses for individual users
- Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
- Location - Based anywhere in the world and able to work remotely in an asynchronous, self-directed capacity
- Language - Fluent in Mandarin as it is used in Singapore, both written and spoken, including local vocabulary, expressions, and usage. You should also have strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English.
- Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
- Must have a Bachelor's degree or higher
- Strong written communication in Mandarin (Singaporean usage) and English at B-2 level proficiency
- Ability to work independently in a remote, asynchronous environment
Degree: Bachelor's
Similar jobs
Tamil AI Evaluation Specialist (Singaporean Dialect)Tamil (Singaporean Dialect)EnglishAI Response Evaluation+2$30/hr
π Worldwide
Malay AI Evaluation Specialist (Singaporean Dialect)Malay (Singaporean Dialect)EnglishAI Evaluation+2$30/hr
π Worldwide
Japanese AI Evaluation Specialist (US / Japan)JapaneseEnglishJudgment+0$30/hr
π US or Japan
Search Engine Evaluator - Italian (Switzerland)Online ResearchSearch Engine EvaluationData AnnotationWeb Browsing+3$30/hr
π¨π Switzerland