Art Domain Expert for LLM Evaluation

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI recruits contributors for projects that help improve artificial intelligence, giving specialists a way to build credible experience and develop a lasting professional portfolio.

Creating an OpenTrain account is free. You can use your profile to discover relevant AI training work, highlight your expertise, and apply in minutes.

• Remote contract work with a global contributor community
• A profile designed to help you build experience in AI training
• Opportunities to apply specialized knowledge to cutting-edge AI systems

About AI Training and LLM Evaluation

Large language models learn from examples created and reviewed by people. In evaluation work, experts write prompts, compare model responses, identify weaknesses, and explain what makes an answer accurate, useful, nuanced, and well supported.

Your art expertise will help assess whether AI systems understand artistic, historical, architectural, and cultural subjects rather than producing convincing but incorrect or superficial answers.

• Create and assess examples that improve generative AI
• Identify factual errors, hallucinations, ambiguity, and outdated information
• Help shape how advanced AI systems respond to specialized questions

The Role

OpenTrain AI is recruiting an Art Domain Expert for LLM evaluation. You will create advanced prompts and review model-generated responses across fine arts, visual arts, architecture, design, art history, museums, artists, cultural traditions, and related subjects.

The work requires careful, objective judgment. You will evaluate accuracy, reasoning, completeness, nuance, and cultural context, then support your conclusions with authoritative references and evidence-based explanations.

• Focus areas include fine arts, visual arts, architecture, design, museums, and art history
• Work with text-generation, response-ranking, and evaluation-rating tasks
• Collaborate with AI researchers while maintaining detailed documentation

What You'll Do

You will help build reliable evaluation materials and benchmarks for large language models. The assignment includes both direct response review and the creation of challenging cases that reveal model limitations.

Strong documentation and annotation quality are essential. Reviews should clearly explain the basis for each judgment and distinguish between accurate, incomplete, misleading, outdated, and culturally insensitive responses.

• Create advanced art-focused prompts across varied topics and difficulty levels
• Compare multiple AI responses and rank them using clear quality judgments
• Check for factual errors, hallucinations, logical inconsistencies, and outdated information
• Identify ambiguity, edge cases, missing context, and weak reasoning
• Use authoritative references to explain why an answer is correct or incorrect
• Develop benchmark datasets and adversarial test cases
• Suggest improved prompts and provide evidence-based model feedback
• Maintain careful annotation quality and project documentation

Requirements

A master's degree or higher is required. Relevant study may include art history, fine arts, visual arts, museum studies, design, humanities, cultural studies, or a closely related field.

You must have at least three years of relevant professional experience in art research, academia, museums, galleries, curation, criticism, journalism, education, publishing, or arts and cultural content.

• Advanced knowledge of fine arts, visual arts, architecture, design, art history, museums, and major artists
• Knowledge of major artworks, movements, styles, periods, techniques, cultural traditions, and visual arts developments
• Excellent written English
• Strong research, analytical, and evidence-based review skills
• Careful attention to detail and objective professional judgment
• Ability to identify factual inaccuracies, hallucinations, ambiguity, outdated information, and edge cases

Helpful Background

Experience with large language models, generative AI, prompt engineering, or AI evaluation is useful but not required. Published research, teaching experience, and the ability to work independently are also valued.

This assignment is a strong fit for an art specialist who can translate deep subject knowledge into precise, consistent evaluations and communicate the reasoning behind each decision.

• Experience evaluating or improving generative AI systems
• Prompt engineering or large language model experience
• Published research or academic writing
• Teaching experience
• Experience producing objective, evidence-backed reviews independently

Schedule and Location

This is a worldwide remote contractor assignment for eight weeks. The role details specify 40 hours per week, including at least four hours of overlap with Pacific Time. The listing is also marked as requiring 20+ hours per week, so confirm the current scheduling expectations during the application process.

The work is conducted in English. Compensation details are not disclosed.

• Remote worldwide opportunity
• Eight-week assignment
• Contractor engagement
• Role schedule specifies 40 hours per week
• At least four hours of Pacific Time overlap required
• English-language work
• Compensation not disclosed

Why Build an AI Training Career

AI training is the human side of building artificial intelligence. Specialists contribute the knowledge, judgment, and feedback that help models produce more accurate and useful results across real-world subjects.

The field offers remote work and opportunities to apply professional expertise to state-of-the-art technology. Through OpenTrain, you can build a profile that showcases your contributions and supports continued growth in AI training and data labeling.

• Apply art expertise to rapidly developing AI technology
• Work remotely with flexible opportunities across the AI training industry
• Build documented experience that can support a longer-term portfolio
• Help improve how AI understands art, history, design, and culture

How to Apply

Create a free OpenTrain account, complete your profile, and apply through OpenTrain. Highlight your relevant degree, professional experience, research or teaching background, and any work with generative AI or model evaluation.

• Create or update your free OpenTrain profile
• Showcase your art-related education and professional experience
• Describe relevant research, publishing, teaching, or curatorial work
• Mention experience with LLMs, prompt engineering, or AI evaluation
• Apply in minutes through OpenTrain