Domain Experts: Paid Assessment on AI Prompt Design
Terac · 100% remote · Contract · Posted
- Pay
- $50 one-time
- Location
- Worldwide
- Languages
- English
- Hours
- 约1小时
- Openings
- Not listed
- Level
- Expert
Summary
设计并测试一个苛刻的AI提示,记录模型失败点,并撰写评分标准,以评估AI在复杂任务上的表现。
What you'll do
- 根据真实工作流程设计一个苛刻的AI提示
- 在录屏会话中测试提示并记录模型失败点
- 修改提示使其更具挑战性
- 撰写一份他人可用的综合评分标准
- 提交提示、失败笔记、评分标准和生成的输出
Requirements
- 拥有深厚专业领域知识并能快速判断高质量输出
- 能设计要求真实推理和计算的复杂提示
Skills
- Prompt Engineering
- AI Evaluation
- Domain Expertise
- ChatGPT
- Rubric Creation
Full description
What We're Researching
We are running a paid study on advanced AI capabilities to find people who excel at designing tasks that expose where models fall short. This work feeds into a larger effort to evaluate and improve how artificial intelligence handles complex, multi-step requests. High performers in this trial assessment will be considered for ongoing paid research projects.
How It Works
You will spend about an hour creating a demanding prompt based on a real workflow you know deeply. During a screen-recorded session, you will test your prompt in ChatGPT, identify where the model fails to deliver a complete file, and refine the request to make it harder. Finally, you will write a comprehensive grading rubric that someone else could use to evaluate any AI's attempt at your task. You will hand back your prompt, failure notes, rubric, and the generated file for review.
Who This Is For
We welcome professionals, domain experts, and knowledge workers from any field who deeply understand complex, specialized workflows. You must be able to recognize a high-quality output in your area of expertise within seconds. We are looking for individuals who can creatively translate their daily tasks into challenging scenarios that require real reasoning and calculation.
Similar jobs
AI Engineers: Intro Call for Open-Source Agent CookbookAI AgentsAgentic WorkflowsAPI IntegrationHuman-in-the-Loop SystemsOpen Source+3$50
🌍 Worldwide
Backend Developer - AI TrainerPythonJavaScript/TypeScriptJavaC#GoPytest+6$25–50/hr
🌍 Europe
Full-Stack DeveloperPythonJavaScript/TypeScriptJavaC#GoPytest+6$25–50/hr
🌍 Germany, Italy, Japan
Coding, Data and Automations ExpertsPythonJavaScriptSQLData EngineeringData AnalysisN8n+5$50/hr
🌍 Worldwide