Product Design & AI Development Evaluation Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI is hiring contractors to help shape how advanced AI systems learn to support product builders, designers, and developers.

About AI Training Work

AI training is the human side of building artificial intelligence. Experts create examples, evaluate model outputs, and write guidance that helps AI systems produce more useful and reliable work. This role focuses on evaluating product design and AI-assisted software development through realistic, expert-authored tasks.

• Work remotely with flexible contractor scheduling.
• Contribute to the development of cutting-edge AI systems.
• Use your professional judgment to distinguish authentic senior-level work from generic responses.

The Role

OpenTrain AI is seeking a Product Design and AI-Assisted Development Evaluation Expert. You will design evaluation tasks for AI systems operating in rapid prototyping, product design, and human-AI collaborative coding.

The role includes two related tracks: Vibecoding, covering AI-assisted, natural-language-driven software development and rapid prototyping; and Design, covering product design, UX/UI, and visual design systems.

• Contractor, part-time engagement
• Worldwide remote opportunity
• 20+ hours per week
• English-language work
• $70–$80 USD per hour

What You'll Do

You will create scenarios, reference materials, and evaluation criteria that reflect how experienced product builders and designers approach real work. Your deliverables may include prototypes, code artifacts, design specifications, and usability evaluation reports.

• Construct scenarios involving rapid prototyping cycles, design system development, and product-design-engineering collaboration.
• Build tasks across AI-assisted application development, natural-language-to-code workflows, and rapid prototyping.
• Create tasks covering UX/UI design, design systems, user research, and usability testing.
• Develop scenarios using tools such as Cursor, Claude Code, v0, and Replit for Vibecoding.
• Develop design scenarios using Figma, Framer, and design systems tooling.
• Apply subdomain-specific methodologies to produce reference prototypes, code artifacts, design specifications, and usability evaluation reports.
• Author rubrics that capture how senior product builders and designers think.

Required Experience And Skills

This opportunity is intended for experienced professionals with a strong background in product design, design leadership, or AI-assisted software development. Direct ownership of work shipped to production is required.

• 5+ years as a product designer, design lead, or AI-native engineer or vibecoder at a major design-forward or product-forward company.
• Direct ownership of product design systems or AI-assisted development workflows shipped to production.
• Fluency in Vibecoding or design tooling.
• Understanding of user-centered design principles.
• A portfolio of shipped work is strongly preferred.
• Prior authorship of evaluation rubrics, training materials, or design critiques is a plus.

Who Should Apply

Apply if you can translate real product-building and design expertise into precise AI evaluation tasks. Strong candidates will be able to define what excellent work looks like, create credible reference outputs, and explain the judgment behind their standards.

• Product designers with ownership of production design systems
• Design leads experienced in UX/UI, user research, usability, or visual systems
• AI-native engineers and experienced Vibecoders
• Professionals who have shipped work at major design-forward or product-forward companies
• Experts with experience writing rubrics, training examples, or structured design critiques

How It Works

OpenTrain makes it easier to discover and build a career in AI training and data labeling. Create a free OpenTrain account, build your profile, and apply to relevant projects in minutes.

• Review the opportunity and confirm that your experience matches the requirements.
• Showcase relevant shipped work and professional expertise in your profile or application.
• Contribute remotely as a flexible, part-time contractor.