Japanese AI Evaluation Specialist (Japan)
Handshake AI Β· 100% remote Β· Contract Β· Posted
- Pay
- $30/hr
- Location
- Japan
- Languages
- Japanese
- Hours
- Flexible
- Openings
- Not listed
- Level
- Experienced
Summary
Evaluate AI-generated responses in Japanese, share personal preferences, and provide written feedback to help improve AI personalization.
How the pay compares
This job pays $30 an hour.
- Coding jobs: median $63 an hour across 202 open hourly jobs. This job pays $33 less.
- Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $50 less.
What you'll do
- Complete annotation tasks using your own real-world experience with AI tools
- Compare and evaluate AI-generated responses, sharing honest preferences and reasoning
- Provide clear written feedback to help AI personalize responses for individual users
Requirements
- Be based in Japan and able to work remotely in an asynchronous, self-directed capacity
- Be fluent in Japanese, both written and spoken, with strong written communication
- Have prior hands-on experience using ChatGPT or similar AI chat assistants
- Be comfortable forming and defending preferences between AI-generated responses
- Be comfortable sharing your own ChatGPT conversation history for research and product improvement
- Have a Bachelor's degree
Skills
- Japanese Language
- ChatGPT
- AI Chat Assistants
- Critical Thinking
- Written Communication
Full description
Opportunity Overview
Handshake is looking for Japanese speakers based in Japan to help make AI responses more personalized. This is not a traditional job - you'll share your own real-world experience using ChatGPT and help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do
Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools
Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning
Provide clear written feedback that helps AI better understand and personalize responses for individual users
Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications
Ideal candidates meet all of the following:
Location - Based in Japan and able to work remotely in an asynchronous, self-directed capacity
Language - Fluent in Japanese, both written and spoken, with strong written communication skills for explaining your reasoning clearly
AI experience - Prior hands-on experience using ChatGPT or similar AI chat assistants, with enough familiarity to compare responses thoughtfully and articulate what makes one answer better suited to a given user than another
Judgment - Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle
Required for all applicants
Comfortable sharing your own ChatGPT conversation history for research and product improvement purposes (handled confidentially)
Strong written communication in Japanese
Ability to work independently in a remote, asynchronous environment
Degree: Bachelor's
Similar jobs
Rust Architect / Backend DeveloperRustDevOps+0Not listed
π Worldwide
3D Modeling & Python SpecialistPythonBlenderBpyThree.jsJavaScript3D Modeling+5$22/hr
π Worldwide
AI Evaluators: Assessing a Shopping AssistantPrompt EngineeringData AnnotationSoftware TestingE-CommerceQuality Assurance+4$30/hr
π Worldwide
Full-Stack Developer - AI TrainerPythonJavaScript/TypeScriptBackend DevelopmentTesting FrameworksCode ReviewsRefactoring+6$15β35/hr
π India and Indonesia