Engineering Expert
About this role
About Turing:
Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview
We are seeking experienced AI Evaluation Engineers (Engineering Simulation & Design) to author and validate "model-breaking," simulation-based engineering design problems to train and evaluate state-of-the-art AI agents. Operating across major engineering disciplines, including Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics, you will create complex, multi-constraint tasks where AI agents must interpret requirements, navigate trade-offs, configure open-source simulation tools, diagnose failures, and iterate toward valid solutions. You will analyze agent execution logs, expose systemic reasoning gaps, and build automated, objective graders to elevate frontier model performance.
Job Requirements:
- Education & Expertise: Master’s degree or PhD in Electrical, Mechanical, Aerospace, with 10+ years of hands-on engineering design experience.
- Simulation Tooling: Proficiency with at least one domain-relevant open-source simulation package (e.g., ngspice, PySpice, OpenFOAM, FEniCSx, CalculiX, python-control, CadQuery, build123d, OpenModelica, Cantera, Gmsh) combined with strong Python scripting skills.
- AI Evaluation & Failure Diagnostics: Hands-on experience with modern LLMs/coding agents and evaluation concepts (pass@k, failure-mode analysis, nondeterministic behavior), with the ability to audit trajectory logs and isolate core reasoning/tool-use failures.
- Domain Rigor & Precision: Uncompromising attention to physical plausibility, unit consistency, boundary conditions, convergence criteria, and technical documentation.
- Availability & Commitment: Talent must have weekend on-call availability (part-time engagement is acceptable).
- Technical Infrastructure: Personal desktop/laptop equipped with a stable, high-speed internet connection in a remote setup.
Job Responsibilities:
- Model-Breaking Problem Design: Author original, self-contained engineering design tasks with competing constraints, explicit optimization targets, validated reference solutions, and objective autograders.
- Environment & Simulation Integration: Build, run, and validate problem environments using open-source simulation tools and custom Python test benches.
- Trajectory Analysis & Failure Mode Taxonomy: Evaluate coding agent outputs and execution logs across repeated trials to identify systemic failure modes (e.g., misinterpreting simulator feedback, premature design convergence, physically impossible geometries).
- Difficulty Calibration & Benchmark Refinement: Iteratively refine problem difficulty based on empirical model performance data without introducing ambiguity or missing information.
- Cross-Functional Collaboration: Partner with AI researchers, pod leads, and domain experts to integrate high-rigor benchmarks into the model evaluation pipeline.
Domains:
- Electrical Engineering
- Mechanical Engineering
- Aerospace Engineering
Education & Experience
- Master or PhD from relevant engineering domain is a must for this position.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is required.
Offer Details:
- Commitments Required: 40 hours per week with 4 hours of overlap with PST.
- Engagement type: Contractor
- Engagement Length: upto 24 weeks
Evaluation Process -
- Shortlisted candidates will be sent a Job Interest Form.
- Finalized talents will go through delivery review & proceeded further accordingly.
Key skills
Details
- Pay: Shared during the application process
- Company: Turing
- Location: Remote
- Eligible locations: Worldwide (no restriction)
- Platform: Turing
Frequently asked questions
How much does the Engineering Expert role pay?
Turing does not publish a pay rate for this Engineering Expert position. Pay is shared during the application process and depends on your experience and the scope of the work.
Is the Engineering Expert role remote, and can I work from home?
Yes. Turing lists this Engineering Expert position as fully remote, so you can work from home or anywhere with a reliable computer and internet connection.
Is Engineering Expert full time or part time?
Turing lists this as a contractor remote role. Full details are in the role description above.
Which countries can apply for Engineering Expert?
Turing lists this role with no country restriction. Check the Turing listing for current requirements before applying.
Do I need experience to apply for Engineering Expert?
The requirements are listed in the role description above. Turing screens applicants through its own process, and relevant skills or credentials strengthen your application.
How do I apply for the Engineering Expert role, and is it legit?
Use the apply button on this page to go straight to the official Turing listing. Turing is a real hiring marketplace and applying is free. No legitimate employer charges you to apply.
Stay Updated on Roles Like This
Subscribe to receive fresh openings aligned with Finance & Accounting and AI training roles across Turing, Mercor and JobHub by NeonLabs