Skip to content
AI Trainer Jobs
Companies

Software Engineer

Handshake AI Β· 100% remote Β· Contract Β· Posted

Pay
$150/hr
Location
United States
Languages
English
Hours
Flexible
Openings
Not listed
Level
Expert

Summary

Create expert-level software engineering problems and scenarios, review and evaluate AI-generated responses for technical accuracy and practical feasibility, and provide structured written feedback to improve AI model performance.

How the pay compares

This job pays $150 an hour.

  • Coding jobs: median $63 an hour across 202 open hourly jobs. This job pays $87 more.
  • Handshake AI jobs: median $80 an hour across 238 open hourly jobs. This job pays $70 more.

What you'll do

  • Create expert-level software engineering problems and scenarios grounded in real system design, architecture, and implementation work
  • Review and evaluate AI-generated responses for technical accuracy, practical feasibility, and alignment with how the work is done
  • Provide structured written feedback to help improve AI model performance

Requirements

  • Have at least 1 year of professional, direct hands-on work as a software engineer
  • Hold a Bachelor's degree in Computer Science or a related technical field
  • Demonstrate expertise in one of: backend systems and distributed architecture, infrastructure/cloud/DevOps, or systems programming/performance engineering
  • Have strong written communication and attention to detail
  • Explain complex software engineering concepts clearly
  • Work independently in a remote, asynchronous environment
  • Be based in the United States

Skills

  • Software Engineering
  • Backend Systems
  • Distributed Architecture
  • Infrastructure
  • Cloud Platforms
  • DevOps
  • Systems Programming
  • Performance Engineering

Full description

Opportunity Overview

Handshake is looking for experienced software engineers to support AI research through flexible, part-time contract work. This is not a traditional job - you'll draw on your hands-on experience building and reasoning about production systems and software architecture to evaluate AI-generated content and provide feedback that helps AI reason like a practicing software engineer.

This is an ongoing, project-based opportunity you can take on alongside your current role.

What You'll Do

Use your domain expertise to create expert-level software engineering problems and scenarios grounded in real system design, architecture, and implementation work
Review and evaluate AI-generated responses for technical accuracy, practical feasibility, and alignment with how the work is actually done
Provide structured written feedback to help improve AI model performance
Complete tasks at your own pace with no set schedule or minimum hour requirement
Qualifications

Ideal candidates meet all three of the following:

Industry/research experience - minimum 1 year of professional, direct hands-on work as a software engineer
Degree - Bachelor's degree in Computer Science or a related technical field
Sub-domain depth - demonstrated expertise in one of the following areas:
Backend systems and distributed architecture
Infrastructure, cloud platforms, and DevOps
Systems programming and performance engineering
Additional qualifications (not required, but strengthen your application)

Experience at a recognized, top-tier tech company
Required for all applicants

Based in the United States
Strong written communication and attention to detail
Ability to explain complex software engineering concepts clearly
Ability to work independently in a remote, asynchronous environment

Degree: Bachelor's

Similar jobs

View all jobs