Wisdom O.

Key Skills

Software

Scale AI

Appen

Other

Top Subject Matter

LLM instruction-following and preference ranking (RLHF)

Nlp Domain Expertise

search relevance

Top Data Types

Text

Image

Document

Top Task Types

RLHF

Classification

Freelancer Overview

Senior AI Trainer — Scale AI (Remote) (Jan 2022 – Present). Brings 8+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI, Appen, and Other. Education includes Bachelor of Science, University of Lagos (2019) and Google Data Analytics Certificate, Coursera (2022). AI-training focus includes data types such as Text and labeling workflows including RLHF, Classification, and Evaluation.

Labeling Experience

Senior AI Trainer — Scale AI (Remote) (Jan 2022 – Present)

Scale AITextRLHF

Served as a Senior AI Trainer evaluating LLM responses and supporting RLHF preference-ranking workflows. Drove quality through daily inter-rater evaluation across instruction-following, summarization, creative writing, and code tasks. Helped translate evaluation findings into policy-relevant training data and edge-case coverage. • Wrote preference justifications for RLHF pipelines • Ranked model responses and captured edge cases for policy updates • Maintained 96%+ inter-rater agreement across 5,000+ tasks • Led weekly calibration sessions that reduced team error rates by 24% in 3 months

2022 - Present

AI Data Annotator — Appen (Remote) (Mar 2020 – Dec 2021)

AppenTextClassification

Worked as an AI Data Annotator producing 3,500+ high-quality annotation tasks for NLP and relevance-related modeling. Completed labeling for sentiment analysis and image classification and handled domain-specific content that required higher accuracy. Demonstrated sustained annotation quality with a 98.6% score and top-tier global contribution performance. • Annotated NLP, search relevance, sentiment analysis, and image classification • Completed vertical-specific labeling for legal, medical, and software development • Maintained 98.6% quality score and top 5% ranking • Produced 3,500+ labeled tasks for model training

2020 - 2021

Freelance Content Evaluator — Various Clients (Remote) (2019 – 2020)

OtherText

Performed freelance content evaluation for search results and social content with a focus on relevance, quality, and policy compliance. Delivered written rationales to document edge cases and inform downstream fine-tuning decisions. Covered content evaluation across English and Nigerian Pidgin. • Rated search results and social content for relevance and quality • Checked policy compliance and identified edge cases • Provided detailed written rationales for labeling decisions • Supported downstream model fine-tuning and training data selection

2019 - 2020

Education

Work History