Skip to content
AI Trainer Jobs
Companies

Japanese AI Evaluation Specialist (Japan)

Handshake AI Β· 100% remote Β· Contract Β· Posted

Pay
$30/hr
Location
Japan
Languages
Japanese
Hours
Flexible
Openings
Not listed
Level
Experienced

Summary

Evaluate AI-generated responses in Japanese, share personal preferences, and provide written feedback to help improve AI personalization.

How the pay compares

This job pays $30 an hour.

  • Coding jobs: median $63 an hour across 202 open hourly jobs. This job pays $33 less.
  • Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $50 less.

What you'll do

  • Complete annotation tasks using your own real-world experience with AI tools
  • Compare and evaluate AI-generated responses, sharing honest preferences and reasoning
  • Provide clear written feedback to help AI personalize responses for individual users

Requirements

  • Be based in Japan and able to work remotely in an asynchronous, self-directed capacity
  • Be fluent in Japanese, both written and spoken, with strong written communication
  • Have prior hands-on experience using ChatGPT or similar AI chat assistants
  • Be comfortable forming and defending preferences between AI-generated responses
  • Be comfortable sharing your own ChatGPT conversation history for research and product improvement
  • Have a Bachelor's degree

Skills

  • Japanese Language
  • ChatGPT
  • AI Chat Assistants
  • Critical Thinking
  • Written Communication

Full description

Opportunity Overview

Handshake is looking for Japanese speakers based in Japan to help make AI responses more personalized. This is not a traditional job - you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users.

This is an ongoing, project-based opportunity you can take on alongside your current role.

What You'll Do

Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools

Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning

Provide clear written feedback that helps AI better understand and personalize responses for individual users

Complete tasks at your own pace with no set schedule or minimum hour requirement

Qualifications

Ideal candidates meet all of the following:

Location - Based in Japan and able to work remotely in an asynchronous, self-directed capacity

Language - Fluent in Japanese, both written and spoken, with strong written communication skills for explaining your reasoning clearly

AI experience - Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another

Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle

Required for all applicants

Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially)

Strong written communication in Japanese

Ability to work independently in a remote, asynchronous environment

Degree: Bachelor's

Similar jobs

View all jobs