Database Systems Evaluation Expert
Mercor · 100% remote · Contract · Posted
- Pay
- $2200/task
- Location
- Worldwide
- Languages
- English
- Hours
- 25 hours per task
- Openings
- Not listed
- Level
- Expert
Summary
Design database engineering tasks that test AI agents, including problem statements, reference solutions, tests, and grading criteria.
What you'll do
- Design one challenging database engineering task
- Build checks for correctness, failure handling, concurrency, retries, and regressions
- Evaluate performance measures such as latency, throughput, and memory use
- Write clear grading criteria for engineering judgment
- Work with technical reviewers to refine and validate the task
Requirements
- Have at least five years of database-engine internals experience or a database-systems PhD
- Have deep experience with storage engines, query execution, optimization, transactions, replication, or low-latency systems
- Demonstrate strong implementation skills and clear explanations of correctness and performance tradeoffs
- Complete a self-paced technical assessment with recorded verbal responses and a coding exercise
- Use a laptop or desktop with camera, microphone, entire-screen sharing, editor, terminal, Python 3.8+, and a compiler for C, C++, Rust, Go, or Java
Skills
- Python
- C++
- Rust
- Database Internals
- Storage Engines
- Query Optimization
Full description
Applications close Friday, October 9, 2026 at 12:00 p.m. Pacific. We are selecting the first three applicants who qualify for the initial pilot.
About the work
Build real-world tasks that test how well AI agents handle database engineering. Depending on your specialty, your task may cover database-engine implementation, production diagnosis, or application migration.
Each task should include a clear problem statement, a reproducible repository or environment, a working reference solution, tests, and grading criteria that distinguish a robust engineering solution from one that only appears correct.
What you'll do
Design one challenging, self-contained database engineering task.
Build checks for correctness, failure handling, concurrency, retries, and regressions where relevant.
Evaluate performance measures such as latency, throughput, and memory use.
Write clear grading criteria for engineering judgment.
Work with technical reviewers to refine and validate the task.
Who we're looking for
At least five years of hands-on database-engine internals experience, or a database-systems PhD.
Deep experience with storage engines, query execution, optimization, transactions, replication, or related low-latency systems.
Strong implementation skills and clear explanations of correctness and performance tradeoffs.
DBA, SQL analytics, ETL, or application-only database experience does not qualify on its own. You do not need to specialize in every task area.
Application process
Complete a self-paced technical assessment with recorded verbal responses and a coding exercise. You control when to advance between sections. (~25 min)
Use a laptop or desktop with a camera, microphone, and entire-screen sharing. Have your own editor and terminal ready, along with Python 3.8+ and a compiler for C, C++, Rust, Go, or Java. The assessment includes a starter kit and public tests. Complete the assessment independently, without outside AI assistance.
Please apply as soon as possible. We will select the first three qualifying applicants. If the pilot fills, completed assessments may be considered for future work if the project expands.
Paid task after selection
Selected experts will complete one task, with approximately 25 hours of work, followed by technical review and feedback.
Task deadline: Tuesday, October 13, 2026.
Similar jobs
Agent EngineerLLM AgentsAgent EvaluationProduction SystemsCloud SandboxesMCPCompany Data Integration+4$100–500/task
🌍 Worldwide
Software Engineering SpecialistMicrosoft PowerPointSlide ReconstructionPresentation DesignData VisualizationVisual StorytellingContent Editing+8$150–350/hr
🌍 US, UK, Canada
AI/ML Engineer, Internal PlatformsPythonLLMsAWSLangChainFastAPI+2$160–300/hr
🌍 Worldwide
Open Source GitHub MaintainerGitHubC++JavaTypeScriptRustGoLang+5$150–300/hr
🌍 Worldwide