Organic Growth AI Agent Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is recruiting and contracting for this role, giving specialists a way to apply their professional expertise to the development of advanced AI systems.

Creating an OpenTrain account is free. Your profile can help you present credible experience, discover relevant projects, and build a long-term portfolio in AI training.

• Remote contract opportunity
• Part-time engagement of 20+ hours per week
• English-language work
• Pay range of $60 to $100 per hour

About AI Agent Evaluation

AI training is the human side of building artificial intelligence. Experts create realistic examples, review model outputs, and explain what makes an answer accurate, useful, and aligned with professional standards.

In this role, your organic growth judgment will help evaluate AI agents that perform complex marketing workflows. Your feedback can teach agents to reason through ambiguity, prioritize effectively, and avoid plausible but incorrect decisions.

• Work on cutting-edge AI training and evaluation
• Apply real-world marketing judgment to simulated environments
• Help define the quality standards AI agents should meet

The Role

OpenTrain is seeking an Organic Growth AI Agent Evaluation Expert to design and pressure-test simulated marketing environments used to evaluate and improve AI agents. You will create task briefs, realistic marketing artifacts, reference answers, evaluation criteria, and reviews of agent attempts.

The work centers on the decisions, tradeoffs, errors, and quality standards that experienced SEO and AEO practitioners apply across complex organic growth workflows. You should have hands-on ownership experience rather than experience only managing practitioners who perform this work.

• Contractor position
• Part-time workload of 20+ hours per week
• Worldwide opportunity
• English required
• Hourly pay ranging from $60 to $100

What You'll Do

You will develop scenarios that reflect realistic organic growth work, including messy data, conflicting signals, multi-step decisions, and work across marketing tools. You will also assess whether an AI agent's approach meets clear practitioner standards and explain the reasoning behind your evaluation.

• Design task briefs based on hands-on organic growth work
• Identify the issue being tested and the decision a strong practitioner should reach
• Specify documents, dashboards, personas, and tool states needed for realistic scenarios
• Write or review reference answers
• Define criteria that separate strong responses from plausible but incorrect ones
• Evaluate AI agent attempts against clear practitioner standards
• Build scenarios involving diagnosis, prioritization, planning, execution, quality assurance, reconciliation, triage, escalation, research, and reporting
• Create multi-step workflows across marketing tools
• Assess search and answer-engine visibility
• Evaluate content-led acquisition and technical or on-page diagnosis
• Address keyword and topic prioritization
• Analyze web and pricing journey optimization
• Diagnose organic-traffic funnel issues

Required Skills and Experience

This role requires practical fluency with the tools and decisions used in organic growth work. You must be able to explain not only what the correct decision is, but why it is correct and how an experienced practitioner would recognize a weak alternative.

• Hands-on ownership of organic growth or SEO/AEO work
• Practical fluency with Google Analytics 4
• Practical fluency with Google Search Console
• Experience using Semrush or Ahrefs
• Experience with a CMS such as Contentful
• Ability to diagnose organic traffic, technical, on-page, keyword, and funnel issues
• Ability to define evaluation criteria and explain judgments clearly
• Strong written reasoning

Helpful Background

Experience building AI training environments, reinforcement-learning environments, or simulated case studies is helpful. Rubric Academy or Rubric Bootcamp certification is also helpful, but the core requirement is demonstrated ownership of organic growth or SEO/AEO work.

• AI training environment experience
• Reinforcement-learning environment experience
• Simulated case study development
• Rubric Academy certification
• Rubric Bootcamp certification

Why Work in AI Training

AI training and data labeling are among the fastest-growing ways to work in technology. People with specialist knowledge contribute directly to how modern AI systems understand tasks, assess answers, and behave in real-world situations.

The work is remote and often flexible, making it possible to fit projects around other professional commitments while developing experience in an emerging field.

• Work remotely from anywhere with a computer and internet connection
• Choose flexible project hours and workload where available
• Use your existing professional expertise in a growing AI industry
• Build experience shaping state-of-the-art AI systems

How to Apply Through OpenTrain

Create a free OpenTrain account and build a profile that highlights your organic growth, SEO, AEO, analytics, search, and marketing-tool experience. Apply through OpenTrain to be considered for this contract opportunity.

• Create or update your free OpenTrain profile
• Showcase relevant organic growth and SEO/AEO experience
• Highlight your fluency with GA4, Search Console, Semrush or Ahrefs, and Contentful
• Apply in minutes through OpenTrain