Paid Growth AI Agent Evaluation Expert

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. We connect specialists with meaningful projects where their expertise helps improve advanced AI systems.

Creating an OpenTrain account is free. You can build a profile, apply in minutes, and develop a durable portfolio of specialized AI training work.

• Worldwide remote opportunity
• Part-time contractor engagement
• English-language work
• 20+ hours per week

About AI Agent Evaluation Work

AI training is the human side of building artificial intelligence. Experts create realistic examples, review model behavior, and define what strong answers and decisions look like so AI systems can become more useful and reliable.

In this role, your paid acquisition knowledge will help test AI agents in realistic marketing environments. You will assess planning, reasoning, prioritization, and execution across complex scenarios rather than simply checking whether an answer sounds plausible.

• Shape how AI agents handle practical marketing decisions
• Apply professional judgment to ambiguous and conflicting information
• Work remotely with flexible part-time scheduling

The Role

OpenTrain is recruiting a Paid Growth AI Agent Evaluation Expert to design and pressure-test high-fidelity simulated marketing environments used to evaluate and improve AI agents. You will translate practical paid acquisition experience into realistic briefs, artifacts, tool states, judgment calls, and quality standards.

The role is categorized as entry level, but it requires hands-on ownership of paid acquisition budgets and performance results. You will need working fluency with Google Ads, Meta Ads, and Google Analytics 4, plus the ability to explain clearly why a decision is correct.

This is a contractor, part-time opportunity paying $60 to $100 per hour, with an expected commitment of 20 or more hours per week.

• Pay range: $60-$100 per hour
• Engagement: Contractor and part time
• Work location: Worldwide and remote
• Primary language: English

What You'll Do

You will build tasks grounded in real paid acquisition work and establish the expert standard used to evaluate AI agent attempts. The work requires careful judgment across campaign data, marketing tools, operational workflows, and competing priorities.

• Design task briefs that identify the issue being tested and the decision a strong practitioner should reach
• Specify realistic documents, dashboards, personas, and tool states for simulated tasks
• Write or review reference answers and evaluation criteria
• Separate strong marketing decisions from plausible but incorrect responses
• Review AI agent attempts against an expert standard
• Diagnose messy or conflicting campaign data
• Assess prioritization, tradeoffs, quality assurance, reconciliation, triage, escalation, reporting, research, and multi-step work across several tools
• Evaluate campaign performance diagnosis, budget allocation, funnel and pipeline diagnosis, lead recovery, account-based marketing, and web or pricing journey optimization

Required Qualifications

You should bring direct paid acquisition experience and be comfortable making performance decisions from incomplete, messy, or conflicting information. Clear written reasoning is essential because you will need to explain prioritization, tradeoffs, quality assurance, and escalation decisions.

• Hands-on ownership of paid acquisition budgets and performance results
• Working fluency with Google Ads, Meta Ads, and Google Analytics 4
• Ability to diagnose campaign, funnel, and pipeline problems
• Ability to define reference answers and evaluation criteria
• Ability to distinguish strong marketing decisions from plausible but incorrect ones
• Clear written reasoning for prioritization, tradeoffs, QA, and escalation decisions
• English-language fluency for the role's written evaluation work

Helpful Background

Experience building AI training environments, reinforcement learning environments, or simulated case studies will help you contribute quickly. Rubric Academy or Rubric Bootcamp certification is also helpful, though these are not listed as required qualifications.

• AI training environment development
• Reinforcement learning environment experience
• Simulated case study design
• Rubric Academy certification
• Rubric Bootcamp certification

Why Work With OpenTrain

AI training and data labeling are rapidly growing forms of work in tech. Contributors help prepare examples, evaluate outputs, and guide the behavior of modern AI systems, often through flexible remote projects that fit around other commitments.

OpenTrain gives you one place to discover relevant opportunities, apply your paid growth expertise, and build a unified portfolio of specialized work. A stronger profile can help you show credible experience and grow an AI training career over time.

• Apply domain expertise to cutting-edge AI work
• Build a portfolio of specialized evaluation experience
• Discover projects aligned with your skills
• Create an OpenTrain account for free

How to Apply

Create or update your free OpenTrain profile, highlight your paid acquisition experience, and apply for this contract through OpenTrain. Make sure your profile reflects your experience with paid budgets, campaign performance, Google Ads, Meta Ads, and Google Analytics 4.

• Confirm that you can commit to 20+ hours per week
• Showcase your paid acquisition ownership and analytical judgment
• Apply in minutes through OpenTrain