Music Domain Expert for AI Response Evaluation

You will help train AI systems to give better answers about music. The work covers music theory, composition, genres, composers, artists, instruments, production, notation, music history, and current music trends.

• Write advanced prompts about music theory, genres, composers, artists, production, and instruments.
• Review AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Find made-up information, logical inconsistencies, outdated claims, and unusual edge cases.
• Build benchmark datasets and adversarial test cases to challenge AI systems.
• Give clear, evidence-backed feedback supported by reliable references.
• Work with AI researchers and maintain consistent annotation quality and documentation.

What it pays and takes

Compensation is not disclosed for this assignment. The role is listed as a contractor and part-time engagement, with an experience level marked as entry level, although the role description requires advanced academic training and prefers relevant professional experience.

• Remote assignment open worldwide.
• Eight-week contract requiring 40 hours per week, including at least four hours of Pacific Time overlap.
• The listing also records a time requirement of 20 or more hours per week.
• A master's degree or higher is required.
• Preferred academic backgrounds include music, music theory, musicology, ethnomusicology, music education, music production, audio engineering, performing arts, or a related field.
• Strong knowledge of music theory, composition, genres, composers, artists, instruments, music history, production techniques, notation, and contemporary trends.
• Three or more years of relevant experience is preferred in music education, performance, composition, production, journalism, research, content creation, audio engineering, or a related field.
• Excellent written English, research skills, analytical ability, attention to detail, and objective, evidence-backed review skills.
• Experience with large language models, generative AI, prompt engineering, or AI evaluation is beneficial.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training uses examples and human reviews to help artificial intelligence systems produce more accurate and useful responses. People with strong subject knowledge help by writing prompts, checking answers, finding errors, and explaining what a better response should include.