Skip to content
AI Trainer Jobs
Companies

Korean AI Evaluation Specialist (South Korea)

Handshake AI ยท 100% remote ยท Contract ยท Posted

Pay
$30/hr
Location
South Korea
Languages
Korean
Hours
Flexible
Openings
Not listed
Level
Experienced

Summary

Evaluate and rank AI-generated responses using personal experience with ChatGPT, compare options, and provide written feedback to improve personalization for individual users.

How the pay compares

This job pays $30 an hour.

  • Generalist jobs: median $60 an hour across 273 open hourly jobs. This job pays $30 less.
  • Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $50 less.

What you'll do

  • Complete tasks on Handshake's annotation platform
  • Compare and evaluate AI-generated responses and share honest preferences
  • Provide clear written feedback to help AI personalize responses
  • Work at your own pace with no set schedule

Requirements

  • Be based in South Korea and able to work remotely asynchronously
  • Be fluent in Korean, both written and spoken
  • Have prior hands-on experience using ChatGPT or similar AI chat assistants
  • Be comfortable forming and defending preferences between AI responses
  • Be willing to share your ChatGPT conversation history confidentially
  • Have strong written communication in Korean
  • Work independently in a remote, asynchronous environment

Skills

  • Korean Language
  • ChatGPT
  • AI Chat Assistants
  • Written Communication
  • Critical Evaluation

Full description

Opportunity Overview

Handshake is looking for Korean speakers based in South Korea to help make AI responses more personalized. This is not a traditional job - you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users.

This is an ongoing, project-based opportunity you can take on alongside your current role.

What You'll Do

  • Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
  • Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
  • Provide clear written feedback that helps AI better understand and personalize responses for individual users
  • Complete tasks at your own pace with no set schedule or minimum hour requirement

Qualifications

Ideal candidates meet all of the following:

  • Location - Based in South Korea and able to work remotely in an asynchronous, self-directed capacity
  • Language - Fluent in Korean, both written and spoken, with strong written communication skills for explaining your reasoning clearly
  • AI experience - Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another
  • Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle

Required for all applicants

  • Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially)
  • Strong written communication in Korean
  • Ability to work independently in a remote, asynchronous environment

Degree: Bachelor's

Similar jobs

View all jobs