Art Domain Expert for AI Evaluation

You will help evaluate AI systems using your knowledge of fine arts and visual arts. The work combines prompt writing, response review, research, and clear written feedback.

You will work across fine arts, visual arts, architecture, design, art history, museums, and artists. You will also help improve benchmark datasets and test cases used to measure model performance.

• Create challenging prompts about art and related subjects.
• Review AI-generated responses for factual accuracy, reasoning, completeness, and nuance.
• Find hallucinations, logical inconsistencies, outdated information, and edge cases.
• Compare and rank responses, explaining your decisions with reliable references.
• Identify ambiguous questions and suggest better prompts.
• Develop benchmark datasets and adversarial test cases.
• Maintain consistent annotation quality and clear documentation.
• Work with AI researchers to improve model performance.

What It Pays And Takes

This is a contract, part-time role open worldwide. The work requires at least 20 hours per week and professional-level written English.

• Relevant professional or academic expertise in fine arts, visual arts, art history, design, museum studies, humanities, or a related field.
• A master's degree or higher is expected.
• At least three years of relevant experience is preferred, including work in art research, academia, museums, galleries, curation, criticism, journalism, education, publishing, or cultural content.
• Strong research and analytical skills, careful attention to detail, and accurate judgment about artistic, historical, and cultural information.
• Ability to work independently and provide objective, evidence-backed reviews.
• Experience with large language models, generative AI, prompt engineering, or AI evaluation is preferred.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is a platform where people find AI training and data-labeling projects, build a profile, and start applications.

About AI Training Work

AI training is the human work behind systems that generate and evaluate content. Contributors write examples, review model responses, and give structured feedback so AI systems can improve; subject experts are especially useful when accuracy, context, and nuance matter.