AWS Serverless & Infrastructure-as-Code Task Auditor
Mercor · 100% remote · Contract · Posted
- Pay
- $70–90/hr
- Location
- United States
- Languages
- English
- Hours
- Flexible
- Openings
- Not listed
- Level
- Experienced
Summary
Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks, and provide clear, rubric-based written feedback.
What you'll do
- Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks
- Assess multi-service serverless designs
- Assess IaC fidelity
- Assess cross-service integration correctness
- Provide clear, rubric-based written feedback
Requirements
- Have 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions)
- Have strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM)
- Demonstrate ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics
- Be familiar with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior
Skills
- AWS Lambda
- API Gateway
- DynamoDB
- S3
- EventBridge
- SNS/SQS
- Step Functions
- AWS CDK
Full description
Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness — and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions) • Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM) • Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics • Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior
Preferred Qualifications • AWS certifications (Solutions Architect / Developer) • Experience with observability and cost-optimization for serverless workloads • Prior code-review or task-grading experience
Location: open to applicants in United States.
Similar jobs
Staff Software Engineer, Mobile (Android, Kotlin, Full Stack)AndroidKotlinJetpackiOS/SwiftBackend ServicesAPIs+5$50–90/hr
🇺🇸 US
Machine Learning Engineers: Scenario Building for Reinforcement LearningReinforcement LearningSimulation DesignRL FrameworksScenario BuildingPlatform Interfaces+4$90/hr
🌍 Worldwide
AI Developer Trace Task AuditorCursorGitHub CopilotClaude CodeDebuggingFull-Stack DevelopmentBackend Systems+6$70–90/hr
🇺🇸 US
SWE-Bench Task AuditorPythonJavaGoTypeScriptC++SWE-Bench+5$70–90/hr
🇺🇸 US