Skip to content
OpenTrain AIFor AI Companies

Software and ML Engineer, LLM Systems Evaluation

Apply now

Job details

Pay

$125 USD/hr

Engagement

Contract

Location

Remote

95 countries

Posted

Nov 7, 2026

OpenTrain on Trustpilot

The work

The title and description of this role name different fields. Check the duties and qualifications below before you apply.

  • Design realistic technical scenarios and problem sets for advanced LLM inference and systems-engineering work.
  • Write reference solutions that show expert reasoning, implementation tradeoffs, and technical standards.
  • Grade model outputs on systems-engineering problems, identifying correctness, performance, and architectural strengths or weaknesses.
  • Write clear technical explanations and feedback that distinguish acceptable answers from excellent ones.

Requirements

  • Schedule: Remote, part-time contract work with a flexible schedule.
  • Language: Professional fluency in English.
  • Education: A bachelor's degree or higher in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Required experience: Strong hands-on experience with GPU inference optimization, custom CUDA kernel development, model-serving systems, quantization, or optimizer design.
  • Professional background: Experience owning systems-engineering work at a recognized technology or AI company.
  • Communication: Strong written communication skills for technical explanations, reference solutions, and model feedback.

Open to applicants in

  • Albania
  • Algeria
  • Antigua and Barbuda
  • Armenia
  • Australia
  • Austria
  • Bahamas
  • Bahrain
  • Belgium
  • Benin
  • Bhutan
  • Bosnia and Herzegovina
  • Botswana
  • Brunei
  • Bulgaria
  • Canada
  • Costa Rica
  • Côte d’Ivoire
  • Croatia
  • Cyprus
  • Czechia
  • Denmark
  • Ecuador
  • El Salvador
  • Estonia
  • Ethiopia
  • Finland
  • France
  • Gambia
  • Germany
  • Greece
  • Guatemala
  • Guyana
  • Hong Kong
  • Hungary
  • Iceland
  • India
  • Indonesia
  • Ireland
  • Israel
  • Italy
  • Jamaica
  • Jordan
  • Kenya
  • Kuwait
  • Latvia
  • Liechtenstein
  • Lithuania
  • Luxembourg
  • Madagascar
  • Malaysia
  • Malta
  • Mauritius
  • Mexico
  • Moldova
  • Mongolia
  • Morocco
  • Mozambique
  • Namibia
  • Netherlands
  • New Zealand
  • North Macedonia
  • Norway
  • Oman
  • Pakistan
  • Panama
  • Peru
  • Philippines
  • Poland
  • Portugal
  • Qatar
  • Romania
  • Rwanda
  • Saint Lucia
  • Senegal
  • Serbia
  • Singapore
  • Slovakia
  • Slovenia
  • South Africa
  • Spain
  • Sri Lanka
  • Sweden
  • Switzerland
  • Taiwan
  • Tanzania
  • Thailand
  • Trinidad and Tobago
  • Tunisia
  • Türkiye
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

Preferred

  • Helpful background: SGLang, Mamba or Mamba2 architectures, IBM Granite-family models, open-source inference or serving frameworks, distributed inference, continuous batching, or KV-cache optimization.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmw6nmplb002108jpf0imsa38

Keep exploring

Similar open roles

View all AI training jobs

Biology and Life Sciences AI Evaluation Expert

Create and assess difficult biology content used to test and improve large language models. This remote, project-based role is open in the US and requires 20+ hours weekly, advanced biology knowledge, and clear scientific writing.

Generative AI & RLHF
Text
Remote · United States
English
Part-time · Flexible

Posted Nov 21, 2026

Generalist (France) AI E-Commerce Testing

Test e-commerce AI in France by placing, tracking, and canceling orders, reviewing model outputs, and writing clear feedback. The role pays $30 to $49 per hour and requires fluent French, strong English, and local purchase-task equipment.

GeneralistTesterEnglish communication
Generative AI & RLHF
Text
Remote · France
French, English
Part-time · Flexible
Hourly · $30–$49/hr

Posted Nov 21, 2026

E-commerce AI Testing Generalist (German, Germany)

Test German e-commerce transactions and review AI outputs for accuracy and cultural relevance. This part-time contractor role pays $30 to $49 per hour and requires fluent German, strong English, and residence in Germany.

GeneralistTesterEnglish communication
Generative AI & RLHF
Text
Remote · Germany
German, English
Part-time · Flexible
Hourly · $30–$49/hr

Posted Nov 21, 2026

Generalist (Canada)

Test Canadian e-commerce AI by placing, tracking, and canceling online orders, reviewing outputs, and reporting issues. The role pays $30 to $49 per hour with a flexible schedule under 20 hours per week.

GeneralistTesterEnglish communication
Generative AI & RLHF
Text
Remote · Canada
English, French
Part-time · Flexible
Hourly · $30–$49/hr

Posted Nov 21, 2026

Financial Modeller (IB/PE/VC) AI Evaluator

Review AI-generated finance work involving modeling, valuation, and transaction analysis. This remote, asynchronous project offers up to $150 per hour and suits professionals with financial modeling experience.

Generative AI & RLHF
Text
Remote · United States
English
Flexible hours
Hourly · $150/hr

Posted Nov 21, 2026