Senior C# Software Engineer, LLM Code Evaluation
Evaluate how language models handle real C# code, repositories, tests, and bug-fixing tasks. This remote contractor role requires at least 20 hours per week and fluent English.
Posted Jul 20, 2026
About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Senior C++ Software Engineer, LLM Evaluation to support AI training work focused on software evaluation. You will work with open-source repositories, GitHub issues, and software test suites to help evaluate how language models perform on real-world code. Prior AI training experience is not required; the most important qualification is strong software engineering knowledge.
What you will do
Analyze and triage GitHub issues across open-source libraries. Configure repositories and development environments, including Docker-based setups. Run, modify, and test code locally while reviewing unit-test coverage and quality. Assess language-model performance in bug-fixing scenarios and collaborate with researchers to identify repositories and issues that are challenging for language models. You may also lead or support junior engineers on project work.
Required skills
At least three years of software engineering experience. Strong C++ experience and the ability to navigate complex codebases. Proficiency with Git, Docker, and basic software pipeline setup. Comfort running, modifying, and testing real-world projects locally. Experience contributing to or evaluating open-source projects is helpful.
Helpful background
Previous participation in language-model research or evaluation projects is helpful. Experience building or testing developer tools or automation agents is also valuable.
Schedule and location
This is a fully remote contractor assignment for candidates based in India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, or Mexico. The assignment lasts three months and requires at least 40 hours per week, including four hours of overlap with Pacific Time.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.
Open to applicants in
OpenTrain on Trustpilot
Job ID: cmw4vcxvb000a08l5nawa6d0s
Keep exploring
Evaluate how language models handle real C# code, repositories, tests, and bug-fixing tasks. This remote contractor role requires at least 20 hours per week and fluent English.
Posted Jul 20, 2026
Evaluate C++ code, repositories, and LLM performance on real software tasks. This remote contract offers flexible 20, 30, or 40-hour options across 9 countries.
Posted Jul 17, 2026
About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…
Posted Nov 6, 2026
About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…
Posted Nov 6, 2026
About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…
Posted Nov 6, 2026
Browse related job pages
Categories
Languages