Marketing AI Model Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people start and grow careers teaching AI: discover projects, build a unified portfolio, and apply in minutes.

Creating an OpenTrain account is free. We hire and contract contributors directly for specialized AI training work, and we support flexible, remote engagements that fit a variety of schedules and experience levels.

About AI training work in marketing

AI training (data labeling, annotation, and human evaluation) is the human side of building AI models. For marketing-focused work, experts evaluate model outputs that propose brand strategy, growth tactics, messaging, and campaign reasoning so models align with real-world marketing judgment.

This role places you at the intersection of applied marketing and advanced language models: your feedback and solutions directly shape how AI understands brand strategy and performance marketing decisions.

The Role

We are hiring a Marketing AI Model Evaluation Expert to evaluate AI outputs, author high-quality solutions, and refine scoring rubrics for marketing judgment tasks. The work centers on brand strategy, growth marketing, and campaign reasoning.

This is a remote contractor role open to candidates based in the United States. Employment type: contractor, part-time. Labeling work types: RLHF and evaluation-rating for text data.

What you'll do

Apply your marketing expertise to assess and improve model responses using structured rubrics and written feedback. Produce clear, practical solutions grounded in real marketing practice.

• Evaluate AI model outputs against structured rubrics and provide clear written feedback on correctness, judgment, and reasoning quality.
• Design challenging marketing tasks and write well-reasoned solutions grounded in real marketing practice.
• Develop and refine evaluation guidelines and scoring rubrics specific to marketing tasks.
• Collaborate with other subject matter experts to close knowledge gaps in brand strategy, growth marketing, and campaign reasoning.

Requirements

You must bring deep, documented marketing experience and hands-on evaluation experience with LLMs or AI outputs.

Reliable weekday availability and strong communication skills are required to meet the role's weekly commitment and collaboration needs.

• 8+ years of professional experience in marketing, including brand strategy, growth marketing, or performance marketing.
• Hands-on experience evaluating LLM or AI model outputs against rubrics or structured scoring criteria.
• Ability to write accurate, well-reasoned solutions for marketing judgment tasks.
• Strong written and verbal communication, problem-solving, and interpersonal skills.
• Reliable weekday availability for a substantial weekly commitment.

Compensation & hours

Pay rate: $60 to $80 per hour. Default commitment is 35 hours per week, with a time expectation of 20+ hours/week required by the project structure.

This role is contractor, part-time and fully remote for contributors located in the United States.

How it works & how to apply

Create a free OpenTrain account, complete your profile with your marketing experience, and apply through the platform. Our process focuses on skills and sample evaluations to confirm rubric alignment.

If selected, you'll begin by reviewing onboarding materials and calibration tasks to ensure consistent scoring. Ongoing work includes evaluation assignments, rubric refinement sessions, and collaboration with other experts.

• OpenTrain is the hiring and contracting organization for this role; you will work directly with OpenTrain for assignments and payments.
• Applications should demonstrate marketing experience and past work evaluating AI outputs or using structured scoring criteria.