LLM Evaluation Specialist

As an LLM Evaluation Specialist, you will test large language models and assess how well they perform. You will use careful reasoning, follow detailed instructions, and review model behavior accurately while working independently in a mainly asynchronous setting.

• Test large language models as part of AI training projects.
• Use general academic knowledge and reasoning to evaluate model performance.
• Follow detailed instructions while completing evaluation tasks.
• Review model behavior carefully and provide work that can support better system performance.
• Work independently in a remote, primarily asynchronous environment.

What it pays and takes

This is a part-time freelance contractor role for short-term AI training projects. The work is suitable for students and graduates from any academic discipline, and no specific professional or AI training background is required.

• Pay: Up to $40 per hour.
• Work type: Remote, part-time freelance contract work.
• Location: United States.
• Language: English.
• Hours: The structured role details list 20+ hours per week; the role description says there is no minimum weekly commitment.
• Education: Current enrollment in an associate, bachelor's, or master's program, or completion of a degree.
• Requirements: Strong reasoning, exceptional attention to detail, consistent accuracy, and comfort working independently.
• Training: Openness to brief training and learning new evaluation workflows.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems such as language models, including testing responses and rating model performance. OpenTrain hires and contracts contributors for this work, and people with strong judgment are paid to help make AI systems more useful and reliable.