Finance AI Model Evaluator

About OpenTrain

OpenTrain is the leading platform for building careers in AI training and data labeling. We help people find and grow work that teaches AI systems — create a free profile, discover projects, and apply to roles that match your expertise.

This role will be contracted through OpenTrain. Our community connects finance professionals with cutting-edge AI work where your domain experience directly shapes how models behave.

• Create a free OpenTrain account to apply and manage your assignments.
• Work remotely and build a portfolio of AI training tasks tied to your finance expertise.

About AI Training Work

AI training (data labeling / human feedback) is the human side of building intelligent systems. Modern models learn from examples and judgments provided by people — from rating model outputs to creating evaluation rubrics that guide model behavior.

This work is ideal for professionals who want flexible, remote, part-time work that directly influences state-of-the-art AI in their domain.

• Flexible, remote work that fits around other commitments.
• Contribute to how finance-focused AI systems are trained and evaluated.

The Role

OpenTrain is hiring finance experts to evaluate large language model (LLM) performance on finance tasks, design domain-specific rubrics, and collaborate with researchers to improve training and evaluation methods. The work focuses on text-based model outputs and combines evaluation ratings with RLHF-style feedback.

• Job type: Contractor, part-time.
• Time commitment: 20+ hours/week.
• Pay: $100 USD per hour.
• Data type: Text; Label types: Evaluation rating and RLHF.

What You Will Do

• Review model outputs on finance problems and identify failure modes and quality gaps.
• Design and document rubrics that measure model capability in your finance subdomain.
• Provide detailed, structured feedback and ratings to guide model training.
• Work with other finance specialists and researchers on evaluation strategies and benchmarks.

Requirements

We need professionals with hands-on finance experience who can translate domain expertise into clear evaluation criteria and critiques of model behavior.

• Minimum 2+ years' experience in a finance domain (capital markets, portfolio management, trading, investment banking, private equity, venture capital, FP&A, accounting, or financial consulting).
• Strong command of investment analysis, forecasting, revenue builds, corporate finance, asset management, and risk management.
• Experience creating assessment rubrics or evaluation benchmarks and the ability to evaluate LLM performance in finance.
• Excellent written English communication.
• Preferred credentials: CFA, CA, CPA, or MBA in Finance (helpful but not required).

Who Should Apply

This role is a strong fit for finance practitioners who want to apply their domain knowledge to shape AI systems. Typical applicants include analysts, traders, portfolio managers, accountants, investment bankers, and consultants with a practical grasp of finance concepts.

• You enjoy explaining complex finance reasoning in writing and creating measurable evaluation criteria.
• You can commit 20+ hours/week and work as a contractor on a part-time basis.
• You are comfortable working remotely and collaborating with researchers and other subject-matter experts.

How It Works

Apply through your OpenTrain profile. This project is open to contributors worldwide who meet the stated requirements. Assignments are contracted, paid hourly at $100 USD, and focused on text-based evaluation and RLHF-style feedback.

OpenTrain lets you centralize your AI training work and build a portfolio of projects that reflect your finance expertise.

• Role is contractor, part-time, paid per hour at $100 USD.
• Work is remote and available worldwide; English fluency required.