Allen M.

Key Skills

Software

Scale AI

Remotasks

Appen

Other

Top Subject Matter

Financial analysis

investment reasoning

risk assessment

Top Data Types

Text

Document

Top Task Types

RLHF

Data Collection

Freelancer Overview

AI Financial Evaluator & RLHF Specialist (Freelance/Contract). Brings 7+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Outlier, Aligneer, and DataAnnotation. Education includes Bachelor of Science, University of California (2016). AI-training focus includes data types such as Text and Document and labeling workflows including RLHF and Data Collection.

Labeling Experience

AI Financial Evaluator & RLHF Specialist (Freelance/Contract)

TextRLHF

Freelance AI Financial Evaluator and RLHF specialist assessing and ranking LLM outputs for financial instruction-following and reasoning quality. Tasks included side-by-side comparisons, rubric calibration, and documenting failure modes to improve RLHF pipelines and model behavior in finance-specific contexts. Annotation work emphasized helpfulness, factual correctness, mathematical accuracy, and adherence to prompts while maintaining high throughput. • Evaluated and ranked LLM responses for earnings analysis, portfolio recommendations, market predictions, and macroeconomic reasoning. • Authored and refined financial prompts to probe derivative pricing, credit risk, and fiscal policy reasoning. • Performed SxS evaluations scoring helpfulness, factuality, math correctness, and instruction adherence. • Calibrated evaluation rubrics and flagged hallucinated figures, miscalculated ratios, and erroneous regulatory citations.

2022 - Present

Data Research Analyst (Financial Services Firm)

OtherDocumentData Collection

Data Research Analyst supporting quantitative research by aggregating, cleaning, validating, and summarizing large financial datasets and documents. Work included quality checks that functioned similarly to annotation QA for downstream research and analytics. Created structured SEC filing summaries (10-K, 10-Q, 8-K) requiring precise reading and summarization for accurate investment research use. • Aggregated, cleaned, and validated datasets of market prices, corporate filings, and economic indicators. • Identified and corrected data quality issues to reduce downstream reporting errors. • Produced structured summaries of SEC filings for senior analyst investment research. • Maintained data pipelines and quality checks that reduced downstream reporting errors by 30%.

2016 - 2019

Education

Work History