Nora

Key Skills

Software

No software listed

Top Subject Matter

AI model evaluation

RLHF-style preference/quality assessment

Reasoning analysis

Top Data Types

Document

Video

Text

Top Task Types

Text Generation

Text Summarization

Fine-tuning

Question Answering

Evaluation/Rating

Data Collection

Classification

Segmentation

Freelancer Overview

I have really enjoyed grading responses against rubrics, but have experience with several different kinds of projects. I've done the true basics (annotating videos) up through some more projects that actually require some applied skill or methodology. Really interested in more rubric work, perhaps rubric creation, and opportunities to do some more creative projects too (aesthetics-based, creative writing [writing or grading], etc.).

Labeling Experience

AI Model Evaluation and Reasoning Analysis (Mercor)

MercorText

Evaluated model outputs in structured assessment environments to judge reasoning quality, factual consistency, clarity, and instruction adherence. Assessed whether responses reflected genuine reasoning versus surface-level approximation or pattern mimicry, and performed detailed comparison and ranking tasks. Identified issues such as inconsistencies, hallucinations, weak logic chains, and formatting deviations while focusing on edge cases and analytical rigor. • Reviewed structured model responses for quality dimensions (reasoning, consistency, clarity, adherence) • Conducted nuanced ranking and calibration using language interpretation • Detected hallucinations, logical weakness, and formatting noncompliance • Worked within precision-focused evaluation frameworks

2026 - Present

Education

Work History