About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Finance AI Evaluation Researcher to help assess how AI agents reason through enterprise finance workflows. You will combine financial domain expertise with evaluation research to create benchmarks, scoring methodologies, quality rubrics, and research protocols that measure the capabilities and limitations of finance-focused AI systems. The work connects financial reasoning, agentic workflows, and rigorous model evaluation.
What you will do
Design and maintain evaluation frameworks, benchmark suites, scoring systems, and research-grade protocols for AI agents in financial domains. Conduct research on financial reasoning, decision-making, and workflow automation, translating findings into measurable model improvements. Develop and curate datasets, test cases, and benchmark environments representing real-world enterprise finance challenges. Evaluate model behavior, failure modes, and performance trends, then produce insights that guide research priorities. Collaborate with research, engineering, and product stakeholders to validate and improve finance-focused models and agentic systems. Publish technical reports, research findings, and best practices while helping establish standards for financial AI evaluation.
Required skills
Advanced education in finance, economics, financial engineering, quantitative finance, or a related discipline. A PhD is strongly preferred, while an MBA, CFA, or equivalent expertise may also be considered. Deep expertise in at least one finance area, such as investment research, capital markets, risk management, corporate finance, accounting, or financial analysis. Demonstrated experience with rigorous research, analytical methodology, or evaluation-framework development. Ability to turn ambiguous financial problems into measurable research questions and evaluation criteria. Strong analytical, critical-thinking, written communication, and cross-functional collaboration skills.
Helpful background
Research or benchmarking experience with large language models, AI agents, reasoning systems, or enterprise AI applications. Familiarity with agentic workflows, AI evaluation, synthetic data generation, model alignment, decision intelligence, or computational finance. Experience designing industry benchmarks, assessment frameworks, or performance standards, with a publication record in academic or industry research. Proficiency with Python, SQL, statistical analysis, experimentation, or machine learning frameworks.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 2 screening questions.