Korean AI Evaluation Specialist (South Korea)
Handshake AI ยท 100% remote ยท Contract ยท Posted
- Pay
- $30/hr
- Location
- South Korea
- Languages
- Korean
- Hours
- Flexible
- Openings
- Not listed
- Level
- Experienced
Summary
Evaluate and rank AI-generated responses using personal experience with ChatGPT, compare options, and provide written feedback to improve personalization for individual users.
How the pay compares
This job pays $30 an hour.
- Generalist jobs: median $60 an hour across 273 open hourly jobs. This job pays $30 less.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $50 less.
What you'll do
- Complete tasks on Handshake's annotation platform
- Compare and evaluate AI-generated responses and share honest preferences
- Provide clear written feedback to help AI personalize responses
- Work at your own pace with no set schedule
Requirements
- Be based in South Korea and able to work remotely asynchronously
- Be fluent in Korean, both written and spoken
- Have prior hands-on experience using ChatGPT or similar AI chat assistants
- Be comfortable forming and defending preferences between AI responses
- Be willing to share your ChatGPT conversation history confidentially
- Have strong written communication in Korean
- Work independently in a remote, asynchronous environment
Skills
- Korean Language
- ChatGPT
- AI Chat Assistants
- Written Communication
- Critical Evaluation
Full description
Opportunity Overview
Handshake is looking for Korean speakers based in South Korea to help make AI responses more personalized. This is not a traditional job - you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
- Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
- Provide clear written feedback that helps AI better understand and personalize responses for individual users
- Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
- Location - Based in South Korea and able to work remotely in an asynchronous, self-directed capacity
- Language - Fluent in Korean, both written and spoken, with strong written communication skills for explaining your reasoning clearly
- AI experience - Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another
- Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
- Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially)
- Strong written communication in Korean
- Ability to work independently in a remote, asynchronous environment
Degree: Bachelor's
Similar jobs
Search Engine Evaluator - German (Switzerland)Online ResearchWeb SearchAI Data Evaluation+1$30/hr
๐จ๐ญ Switzerland
Search Engine Evaluator - French (Switzerland)Online ResearchSearch Engine Usage+1$30/hr
๐จ๐ญ Switzerland
Customer Support Reps - AI TrainingCustomer SupportTechnical TroubleshootingDe-EscalationSupport Quality AssuranceZendeskSalesforce Service Cloud+7$30/hr
๐ Worldwide
Real Estate, Rental and Leasing SpecialistReal EstateProperty ManagementLeasingProperty ValuationZoning RegulationsMarket Analysis+7$10โ30/hr
๐บ๐ธ US