Job Description

Role Overview

Help shape how next-generation AI systems learn, reason, and perform by creating rigorous, real-world social science research evaluations. This remote contract opportunity centers on benchmarking advanced AI capabilities through authentic research scenarios and high-quality evaluation materials. Prior AI experience is not required.

Key Responsibilities

• Design and author complex evaluation tasks based on real social science research work, including survey analysis, qualitative coding, literature reviews, and statistical analysis.
• Source, synthesize, and create realistic research artifacts such as survey instruments, coded datasets, statistical outputs, and source documents.
• Select appropriate methodologies and provide clear, defensible interpretations aligned with social science best practices.
• Create comprehensive grading rubrics with 35 or more items that assess methodological decisions, execution fidelity, and interpretation quality.
• Ensure tasks reflect the nuance and complexity of advanced day-to-day research rather than simplified textbook exercises.
• Collaborate asynchronously with project leads and reviewers to refine tasks, data, and evaluation frameworks.
• Maintain rigorous, detailed, and transparent standards across all deliverables.

Qualifications

• Bachelor''s or Master''s degree in sociology, economics, psychology, political science, or a related social science discipline.
• At least 2 years of hands-on experience designing survey instruments, coding qualitative data, conducting literature reviews, and using statistical software such as SPSS, R, or Stata.
• Ability to synthesize diverse research sources and build well-documented data artifacts.
• Strong methodological rigor and commitment to accurate, reproducible research practices.
• Experience developing or applying comprehensive grading rubrics or evaluation guidelines.
• Comfort with detailed, methodical research assignments involving multiple data types and sources.
• Proficient written English for technical research content and evaluation materials.

Work Terms

• Remote, independent contractor engagement.
• Compensation is output-based and paid for each task that meets project specifications; completion time varies by experience and workflow.
• Minimum submission requirements apply, including a minimum number of tasks per week.
• Roles are typically filled within 48 hours, and selected candidates should be ready to begin promptly.

Compensation

$30 to $50 per hour.

Application Process

Selected candidates complete required onboarding and are expected to begin their first tasks within 24 to 48 hours afterward.

Job Tags

Similar Jobs