Use hands-on PR and corporate communications expertise to design scenarios, create evaluation standards, and review AI agent performance. This remote contract role offers 20 hours per week by default and pays $60 to $100 per hour.
Generative AI & RLHF
100% Remote Hourly · $60–$100/hr
$60–$100/hr
Compensation
Worldwide
Eligibility
Entry
Experience
Aug 30, 2026
Posted
Open worldwide
Interested in this role?
Create a free OpenTrain account and apply in minutes.
OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping people discover projects, build an AI training profile, and apply in minutes.
Creating an OpenTrain account is free, and this opportunity is available as remote contract work for applicants worldwide.
About AI Training and Agent Evaluation
AI training is the human side of building artificial intelligence. Professionals prepare examples, write guidance, and review model outputs so AI systems can make more useful and reliable decisions.
In this role, your public relations judgment will help evaluate AI agents in realistic communications workflows. Your work will contribute to simulated environments that test planning, prioritization, execution, quality assurance, and other professional decisions.
The Role
OpenTrain AI is recruiting a PR and Communications AI Agent Evaluator to help design and pressure-test simulated marketing work environments. You will create realistic scenarios involving email, shared drives, project trackers, media workflows, and launch activity.
The role combines practical public relations expertise with the creation of reference standards that distinguish strong communications decisions from plausible but incorrect ones. This is remote contract work with a default commitment of 20 hours per week.
Contractor and part-time work arrangement
Remote and available worldwide
Default commitment of 20 or more hours per week
Hourly pay of $60 to $100 USD
What You'll Do
You will apply professional communications judgment to messy or conflicting information and evaluate how AI agents handle realistic, multi-step work. Assignments may involve planning, execution, triage, escalation, research, reporting, reconciliation, and quality assurance.
Design task briefs based on real PR and communications work, including the issue being tested and the decision a strong practitioner should reach.
Specify the documents, dashboards, personas, and tool states needed to make each scenario realistic.
Write or review reference answers and criteria that separate strong responses from plausible but incorrect ones.
Review AI agent attempts against professional communications standards.
Build scenarios involving media pitching, embargo and exclusive strategy, announcement sequencing, interview preparation, coverage evaluation, corrections, and launch communications.
Evaluate media strategy, announcement sequencing, coverage quality, and other communications tradeoffs.
Requirements
This opportunity is listed at the entry level, but it requires hands-on experience in PR or corporate communications and direct familiarity with media workflows. You should be able to explain your decisions clearly in writing and evaluate communications work against practical professional standards.
Hands-on PR or corporate communications experience, including pitching reporters.
Direct experience managing embargoes, exclusives, corrections, and launch communications.
Ability to evaluate media strategy, announcement sequencing, and coverage quality.
Clear written reasoning that distinguishes strong communications decisions from plausible but incorrect ones.
Comfort working across email, shared drives, and project trackers as part of a communications workflow.
Practical judgment across media strategy, announcements, coverage, and launch communications.
Helpful Background
Experience creating structured evaluation scenarios can be useful, particularly when it involves AI training, reinforcement-learning environments, or simulated case studies. Familiarity with the listed certification programs is also helpful.
Experience building AI training environments.
Experience building reinforcement-learning environments or simulated case studies.
Rubric Academy or Rubric Bootcamp certification.
How to Apply
Apply through OpenTrain AI to be considered for this remote contract opportunity. The work is conducted in English and is open to candidates worldwide.
AI training and data-labeling work is a growing way to contribute to cutting-edge technology. By bringing your communications expertise to agent evaluation, you can help shape how AI systems plan, execute, and assess professional PR work.
Create realistic evaluation scenarios that test how LLM-based agents handle real-world tasks. This fully remote, part-time contractor role pays $18 to $24 per hour and requires strong English, QA thinking, and basic Python and JavaScript.
Use your brand social media expertise to design realistic scenarios and evaluate AI agent decisions across inboxes, publishing, analytics, and reporting. This remote contract pays $60-$100 per hour for about 20 hours weekly.
Evaluate how AI uses personal context in Polish-language conversations, compare model responses, and write clear quality rationales. This remote contractor role pays $20 per hour for about 4 hours daily.