Rubric Expert — Browser Annotation & Prompt Evaluation

About OpenTrain

OpenTrain is the #1 platform for people building careers in AI training and data labeling. We help freelancers find and grow work that teaches AI systems—everything from annotating images to writing and evaluating model outputs—so you can build a durable, trackable portfolio across projects.

Why AI training work matters

AI systems learn from human examples and decisions. Contributors who create rubrics, annotate data, and evaluate outputs shape how next-generation models behave. These roles are often 100% remote, flexible by design, and open to people with careful attention to detail and clear communication skills.

The role

OpenTrain and our client are recruiting Rubric Experts to support a browser-focused AI training project. You will develop and refine rubrics, perform browser-driven actions to collect and annotate screenshots, and write and interpret prompts for browser-based workflows. This is a contract, part-time position that requires at least 20 hours per week and pays $45 USD per hour.

• Employment type: Contractor, Part-time
• Time commitment: 20+ hours/week
• Pay: $45 USD per hour
• Language: English

What you'll do (day-to-day)

Work from a browser to complete prompted tasks, capture screen images, and annotate specific interface elements. Document the exact sequence of actions and the reasoning used at decision points. Create, refine, and maintain rubrics and guidelines that ensure consistent annotation quality. Review and verify annotations to uphold high data standards.

• Develop, refine, and document rubrics and annotation guidelines
• Navigate web interfaces to perform targeted browser actions accurately
• Capture and annotate screenshots; create bounding boxes where required
• Write and interpret prompts for browser-based workflows (SFT-style)
• Perform quality checks and detailed reviews to ensure consistency
• Communicate clearly in writing and verbally to clarify requirements

Requirements

This role requires proven experience creating rubrics and documenting evaluation criteria, strong annotation experience, and the technical ability to perform precise browser actions. You must be fluent in English and comfortable producing structured documentation of your work.

• Demonstrated expertise in rubric creation, evaluation, and documentation
• Strong background in data annotation and attention to detail
• Technical aptitude for clicking, typing, and navigating complex web UIs
• Proficient at capturing and annotating screenshots for documentation
• Excellent written and verbal communication skills in English

Helpful background and desirable experience

Prior experience with prompt engineering or AI-related projects is a strong advantage. Candidates who have delivered thorough documentation and structured feedback in past annotation or QA roles will be especially competitive.

• Experience with prompt engineering or model evaluation projects is helpful
• Background in structured QA, technical documentation, or UX workflows is a plus

How the project works

You will receive project-specific instructions, rubrics, and prompt templates. Tasks will involve collecting image data (screenshots), applying bounding boxes or other annotations, writing or refining prompts, and completing evaluation or rating tasks as required. Work is performed remotely; you will collaborate with the project team through written and verbal channels to clarify deliverables and resolve edge cases.

• Data type: image (screenshots) with bounding boxes and evaluation ratings
• Labeling types include data collection, evaluation/rating, bounding boxes, and prompt-response writing (SFT)
• (project-provided tools)
• Worldwide applicants welcome