Senior Software Engineer, Go (LLM Evaluation & Repository Validation)
About this role
Job Title: Senior Software Engineer, LLM Evaluation & Repository Validation
About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop; while expanding the dataset coverage to different types of tasks in terms of programming language, difficulty level, and etc.
About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
Why Join Us? Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.
What does day-to-day look like:
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluating unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
- Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
- Minimum 3+ years of overall experience
- Strong experience with at least one of the following languages: Go
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
- Previous participation in LLM research or evaluation projects.
- Experience building or testing developer tools or automation agents.
Perks of Freelancing With Turing:
- Work in a fully remote environment.
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details:
- Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week)
- Employment type : Contractor assignment (no medical/paid leave)
- Location : India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico
Evaluation Process (approximately 75 mins) :
- Two rounds of interviews (60 min technical + 30 min technical & cultural discussion)
Key skills
Details
- Pay: Shared during the application process
- Company: Turing
- Location: Remote
- Eligible locations: India, Pakistan, Nigeria, Kenya, Egypt, Ghana and 3 more
- Platform: Turing
Frequently asked questions
How much does the Senior Software Engineer, Go (LLM Evaluation & Repository Validation) role pay?
Turing does not publish a pay rate for this Senior Software Engineer, Go (LLM Evaluation & Repository Validation) position. Pay is shared during the application process and depends on your experience and the scope of the work.
Is the Senior Software Engineer, Go (LLM Evaluation & Repository Validation) role remote, and can I work from home?
Yes. Turing lists this Senior Software Engineer, Go (LLM Evaluation & Repository Validation) position as fully remote, so you can work from home or anywhere with a reliable computer and internet connection.
Is Senior Software Engineer, Go (LLM Evaluation & Repository Validation) full time or part time?
Turing lists this as a contractor remote role. Full details are in the role description above.
Which countries can apply for Senior Software Engineer, Go (LLM Evaluation & Repository Validation)?
Turing lists eligibility for India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, and 1 more countries. Check the Turing listing for current requirements before applying.
Do I need experience to apply for Senior Software Engineer, Go (LLM Evaluation & Repository Validation)?
The requirements are listed in the role description above. Turing screens applicants through its own process, and relevant skills or credentials strengthen your application.
How do I apply for the Senior Software Engineer, Go (LLM Evaluation & Repository Validation) role, and is it legit?
Use the apply button on this page to go straight to the official Turing listing. Turing is a real hiring marketplace and applying is free. No legitimate employer charges you to apply.
Stay Updated on Roles Like This
Subscribe to receive fresh openings aligned with Finance & Accounting and AI training roles across Turing, Mercor and JobHub by NeonLabs