Strategic Operations Professionals: Task Evaluation and Scoring

AI Training & Evaluation • Paid Gig (Paid interview) • Remote • via Terac

This role is hiring through Terac, not NeonLabs. The description below is Terac’s own wording from their official listing, so "we" and "our" refer to Terac.

Overview

The Strategic Operations Professionals: Task Evaluation and Scoring role is a remote contract position. It suits experienced professionals who want flexible, project-based AI work reviewed on a rolling basis. You collaborate directly with client teams on real deliverables that help train and evaluate next-generation AI systems, with no long-term commitment required.

We are conducting a paid research project focused on translating operational judgment into structured evaluation criteria for artificial intelligence systems. We are looking for experienced strategy and operations professionals to help design scoring rubrics and structured tasks.

What We're Researching

We're running a paid study on how expert operational decision-making can be quantified and structured for artificial intelligence systems. The goal is to better understand how complex human judgments are translated into clear criteria and scoring rubrics. This work directly supports the ongoing improvement of advanced data models.

How It Works

You will participate in a remote session to review various operational scenarios and workflows. During the process, you will be asked to define structured tasks and establish clear evaluation criteria based on your professional experience. We will have you build scoring rubrics that capture the nuances of high-level strategic operations. The session involves focused, independent work alongside guided prompts to capture your logic step by step.

Who This Is For

We welcome operations managers, strategic project leaders, and human-data professionals with deep experience in complex decision-making. You should be highly comfortable taking ambiguous business processes and breaking them down into measurable frameworks. Professionals who regularly design operational metrics or evaluation standards will be an especially strong fit.

What you will do

• Review complex operational workflows and strategic business scenarios
• Translate high-level judgments into structured tasks and clear evaluation criteria
• Design scoring rubrics that accurately measure performance or quality
• Explain the reasoning behind your chosen metrics and operational frameworks

Who qualifies

• Professional background in strategic projects, operations, or human-data workflows
• Experience designing evaluation criteria, rubrics, or operational metrics
• Comfortable breaking down complex, ambiguous workflows into structured steps
• Strong ability to articulate the logic behind operational decisions

Details

• Pay: $40 to $80/hr
• Format: Paid interview • Remote • flexible timing
• Open spots: 50
• Eligibility: United States
• Platform: Terac

Apply directly through Terac using the link below. Terac connects professionals to short, paid research studies, interviews, and surveys you can complete remotely.