ML Challenge Task Auditor
About this role
Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology, and provide clear, rubric-based written feedback.
Basic Qualifications
- 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperparameter tuning, evaluation methodology)
- Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene
- Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost)
- Ability to critique ML claims against evidence and reproduce results
Preferred Qualifications
- Competition / benchmark experience (e.g., Kaggle)
- Graduate research or publication record in applied ML
- Prior task-grading or peer-review experience
Note: this role evaluates applied/experimental ML rigor, it is not an LLM-application-building or MLOps role.
Details
- Pay: $70 to $90/hr
- Company: Mercor
- Location: Remote
- Eligible locations: United States
- Platform: Mercor
Frequently asked questions
How much does the ML Challenge Task Auditor role pay?
Mercor lists this ML Challenge Task Auditor position at $70 to $90/hr. Pay is set by Mercor and your exact offer depends on your experience and the scope of the work.
Is the ML Challenge Task Auditor role remote, and can I work from home?
Yes. Mercor lists this ML Challenge Task Auditor position as fully remote, so you can work from home or anywhere with a reliable computer and internet connection.
Is ML Challenge Task Auditor full time or part time?
Mercor lists this as a contractor remote role. Full details are in the role description above.
Which countries can apply for ML Challenge Task Auditor?
Mercor lists eligibility for United States. Check the Mercor listing for current requirements before applying.
Do I need experience to apply for ML Challenge Task Auditor?
The requirements are listed in the role description above. Mercor screens applicants through its own process, and relevant skills or credentials strengthen your application.
How do I apply for the ML Challenge Task Auditor role, and is it legit?
Use the apply button on this page to go straight to the official Mercor listing. Mercor is a real hiring marketplace and applying is free. No legitimate employer charges you to apply.
Stay Updated on Roles Like This
Subscribe to receive fresh openings aligned with AI Training & Evaluation and AI training roles across Mercor and JobHub by NeonLabs