Willie J.

Key Skills

Software

Don't disclose

Top Subject Matter

LLM evaluation

multilingual content classification and relevance scoring

Multimodal content labeling

Top Data Types

Text

Video

Document

Top Task Types

Classification

Freelancer Overview

AI Data Annotator and LLM Evaluator, Mistral AI (Remote Contract via AfterQuery). Brings 4+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Don't disclose. Education includes Master of Science, University of Minnesota Twin Cities (2023) and Bachelor of Science, Macalester College (2015). AI-training focus includes data types such as Text, Video, and Document and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

AI Data Annotator and LLM Evaluator, Mistral AI (Remote Contract via AfterQuery)

Don't discloseText

Rated and assessed LLM outputs for relevance, appropriateness, and correctness using multi-label scales and ranking tasks. Applied written explanations to flag ambiguous, inconsistent, and out-of-scope samples to improve labeling guidelines. Performed multilingual annotation support to widen cross-lingual training coverage across active LLM projects. • Relevancy scoring on 1–5 scales and pairwise ranking • Binary classification and content appropriateness review • English↔Swahili translation annotation, prompt rewriting, and concise summarization • Provided structured rationale to reduce edge-case escalations and improve agreement

2024 - Present

Multimodal Content Annotator and Domain Expert, Twelve Labs (Remote Contract)

Don't discloseVideoClassification

Labeled and classified multimodal media content across video, audio, and text within large-scale datasets. Used predefined taxonomies to tag branded content and categorize subject matter for dataset curation. Documented labeling rationale and quality assurance findings to enable independent verification and handoff across distributed teams. • Labeled 8,000+ media samples with expert-verified accuracy • Performed data augmentation including paraphrasing and prompt-response generation • Applied systematic content transformations to reduce model overfitting • Produced research-grade documentation of methodology, QA results, and rationale

2023 - 2023

Quantitative Domain Expert and AI Model Evaluator, BlackRock AI Labs (Remote Contract)

Don't discloseDocument

Evaluated AI model outputs against expert-labeled financial and quantitative benchmarks using structured evaluation frameworks. Curated annotation-ready training corpora by collecting and validating data from financial reports, statistical analyses, and research documentation. Built reproducible evaluation and corrective methodologies aligned to project guidelines for high-volume asynchronous review cycles. • Rated output accuracy, appropriateness, and reasoning quality • Designed A/B scenario analyses vs. human-curated ground truth • Identified data anomalies and assessed data quality for labeling readiness • Produced structured written evaluation summaries and documentation

2018 - 2023

Education

Work History