Data Analytics Experts: Benchmark Evaluation Project
Terac Β· 100% remote Β· Contract Β· Posted
- Pay
- $100/hr
- Location
- Worldwide
- Languages
- English
- Hours
- 20 or more hours per week
- Openings
- Not listed
- Level
- Experienced
Summary
Design and structure training tasks for benchmarking data models, creating datasets and defining evaluation criteria for systematic testing.
How the pay compares
This job pays $100 an hour.
What you'll do
- Design training tasks based on real-world data scenarios
- Create datasets
- Define evaluation criteria
- Format problems for systematic testing
Requirements
- Have experience as a data analyst, data scientist, or analytics engineer
- Have a strong background in real-world data analytics
- Be comfortable structuring complex problems
- Be familiar with evaluation metrics
Skills
- Data Analytics
- Data Science
- Evaluation Metrics
- Analytics Engineering
Full description
What We're Researching
We are running a paid project focused on building benchmark evaluations for advanced data models. This work feeds directly into improving how systems interpret and solve complex data analytics problems. High-quality benchmarks are essential for measuring analytical capabilities accurately.
How It Works
You will spend your time designing and structuring training tasks based on real-world data scenarios. The work involves creating datasets, defining evaluation criteria, and formatting the problems for systematic testing. You will work remotely and manage your own schedule while meeting weekly output goals. The project requires a commitment of 20 or more hours per week through the end of the year and potentially beyond.
Who This Is For
We are hiring experienced data analysts, data scientists, and analytics engineers who are comfortable structuring complex problems. You should have a strong background in real-world data analytics and evaluation metrics. We welcome professionals looking for a steady, long-term remote engagement.
How Pay Works
- Application and skills assessment: the screener, the short AI interview and the 45-minute skills assessment are unpaid, with one exception: if you pass the assessment and we forward you to the client's team, we pay you $75.
- Client interview: next comes a paid two-part interview with the client's team.
- Paid trial: if you pass, your first 10 hours of real tasks are paid at $100 an hour, followed by a go/no-go decision.
- After the trial: with a go, you're paid per delivered problem: $1,800 in total for the first one (your trial pay plus $800 on delivery) and $1,400 for each one after that.
All pay goes through your Terac account and is paid out every Sunday.
Similar jobs
AI Red TeamerLLM PromptingAdversarial TestingJailbreak TechniquesPrompt InjectionAI Safety+4$32β95/hr
πΊπΈ US
SOC Investigation Specialist Talent NetworkSOC AnalysisSplunkSIEMIncident InvestigationLog AnalysisEDR Tools+5$70β95/hr
π India and Europe
Unreal Engine DeveloperUnreal EngineC++BlueprintsGameplay Systems DevelopmentDebuggingOptimization+9$50β100/hr
π Worldwide
Software Engineer - BackendPythonJavaRustAlgorithmsBasics C++TypeScript+7$50β100/hr
π Worldwide