Top GitHub Contributors, Agentic Review Project
About this role
About Us
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Project Overview
We are seeking high-caliber researchers and technical experts. The core objective of this role is to enhance the reasoning and problem-solving capabilities of a target frontier model by designing, validating, and analyzing challenging benchmark tasks.
What the role entails:
- Task Design and Development: Design challenging, real-world problems that serve as the foundation for a model. Problems should be constructed to target specific core capability loss failures identified in a leading model.
- Content Generation: Integrate the problems into an Agentic development environment, preparing all necessary components using Python, which include:
- Detailed Instructions and an overview of the required task.
- A Golden solution that follows the instructions.
- The necessary Environment, including datasets, Python libraries, and metadata.
- A Test notebook containing unit tests that solutions must pass.
- Evaluation and Analysis: Evaluate the cross model’s performance on the tasks.
- Headroom Identification: Identify tasks where target model fails to pass all tests, specifically classifying the failure as a logical reasoning failure.
- Loss Extraction: Analyze the agent’s steps (Agent Trajectory) to observe and extract core capability loss patterns from the model.
Required Skills
- Highly-skilled GitHub contributors.
- Applicants must have strong expertise in either data science, ML, coding, or a deep quantitative background in frontier STEM.
- Able to engage reliably for 30+ hrs per week (on weekdays).
Evaluation Process
- The application process takes ~15 minutes.
- Completion of an AI video interview is required.
Key skills
Details
- Pay: Shared during the application process
- Company: Turing
- Location: Remote
- Eligible locations: Worldwide (no restriction)
- Platform: Turing
Frequently asked questions
How much does the Top GitHub Contributors, Agentic Review Project role pay?
Turing does not publish a pay rate for this Top GitHub Contributors, Agentic Review Project position. Pay is shared during the application process and depends on your experience and the scope of the work.
Is the Top GitHub Contributors, Agentic Review Project role remote, and can I work from home?
Yes. Turing lists this Top GitHub Contributors, Agentic Review Project position as fully remote, so you can work from home or anywhere with a reliable computer and internet connection.
Is Top GitHub Contributors, Agentic Review Project full time or part time?
Turing lists this as a contractor remote role. Full details are in the role description above.
Which countries can apply for Top GitHub Contributors, Agentic Review Project?
Turing lists this role with no country restriction. Check the Turing listing for current requirements before applying.
Do I need experience to apply for Top GitHub Contributors, Agentic Review Project?
The requirements are listed in the role description above. Turing screens applicants through its own process, and relevant skills or credentials strengthen your application.
How do I apply for the Top GitHub Contributors, Agentic Review Project role, and is it legit?
Use the apply button on this page to go straight to the official Turing listing. Turing is a real hiring marketplace and applying is free. No legitimate employer charges you to apply.
Stay Updated on Roles Like This
Subscribe to receive fresh openings aligned with Finance & Accounting and AI training roles across Turing, Mercor and JobHub by NeonLabs