Role Overview
Mercor is hiring highly skilled Data Science experts to join a significant research collaboration with one of the world's leading AI labs. The role involves contributing to the development of advanced AI agents by creating evaluations for exploratory data analysis. You'll help train, test, and calibrate these AI systems through identifying patterns, trends and associations in datasets and visualizing the results using Python.
Key Responsibilities
- Evaluate data analysis produced by AI systems for quality and accuracy
- Understand dataset context and execute statistical analysis & modeling for both vague and specific prompts
- Design prompts and create detailed rubrics for fine-grained reward modeling and evaluation.
- Produce gold-standard responses including data visualizations, explanatory text, and executable Python code (ipynb file).
- Clearly translate data scientist reasoning, decision-making, and expertise into gradable criterion for AI agents
Ideal Qualifications
- Bachelor’s, Master’s, or PhD degree in a quantitative field such as data science, computer science, statistics, or mathematics OR 2+ years of industry experience in a data science role
- Proficiency in Python data science libraries (e.g., pandas, numpy, scikit-learn).
- Solid understanding of data analysis techniques, statistical modeling, or machine learning principles. Experience in identifying patterns, trends, and associations within complex datasets, as well as visualizing results to communicate insights, is highly valued.
- Excellent analytical and data-driven writing skills. The ability to distill complex data-driven insights into clear, concise, and compelling analyses is crucial.
Project Timeline
- Start Date: Immediate
- Duration: 5-6 weeks
- Commitment: Part-time, ~10-20 hours/week (flexible)
- Schedule: Fully remote and asynchronous
Compensation & Contract
- The hourly rate for the role is competitive and based on experience ($60-100/hr)
- Top performers on the project may be eligible to receive a bonus-based incentive in the range of $20-$50/hr on top of their pay rate.
- Status**:** Independent Contractor
- Payment**:** Weekly via Stripe Connect
Application & Onboarding Process
- Submit Resume
- AI Interview A short, 25-minute technical interview which will assess conceptual project-based questions and a Google Co-Lab data analysis exercise
About Mercor Mercor specializes in recruiting experts for top AI labs and is based in San Francisco, CA. Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey. Apply today and leverage your data science expertise to advance cutting-edge AI models!
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Link to Apply: https://work.mercor.com/jobs/list_AAABmKdTX17f_nKVFYlLZq7K?referralCode=7274f6a2-452a-42f4-a201-5eb441f22701&utm_source=referral&utm_medium=share&utm_campaign=job_referral
Job Type: Contract
Pay: $60.00 - $100.00 per hour
Expected hours: No less than 10 per week
Work Location: Remote
