For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
J

Johnson O.

LLM Evaluator & Annotator

Kenya flagNairobi, Kenya

Key Skills

Software

AppenAppen
Other
CVATCVAT
ClickworkerClickworker

Top Subject Matter

Large Language Models
AI safety
Multidomain Knowledge

Top Data Types

TextText
AudioAudio
ImageImage
DocumentDocument

Top Task Types

TranscriptionTranscription
Bounding BoxBounding Box
RLHFRLHF
Evaluation/RatingEvaluation/Rating
Data CollectionData Collection
Prompt + Response Writing (SFT)Prompt + Response Writing (SFT)
Fine-tuningFine-tuning
Text SummarizationText Summarization
Object DetectionObject Detection
ClassificationClassification
SegmentationSegmentation
PolygonPolygon
Text GenerationText Generation
CuboidCuboid

Freelancer Overview

LLM Evaluator & Annotator. Brings 7+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Cognito AI, Appen, and Other. Education includes Bachelor of Education, University of Nairobi (2018) and Diploma in Teaching English as a Foreign Language, The TEFL Academy (2024). AI-training focus includes data types such as Text and Audio and labeling workflows including Evaluation, Rating, and Transcription.

Labeling Experience

LLM Evaluator & Annotator

TextText

As an LLM Evaluator & Annotator at Cognito AI, I evaluate and compare AI-generated responses for multiple criteria using structured guidelines. I detect hallucinations, factual errors, and policy violations to ensure safety and quality. This work directly refines large language model (LLM) reasoning and output quality. • Assessed outputs for accuracy, safety, clarity, and helpfulness • Flagged and reported violations or inconsistencies for model alignment • Applied human judgment across diverse knowledge domains • Provided structured feedback through scoring rubrics for LLM refinement

2026 - Present

AI Data Trainer & Evaluator

OtherTextText

As an AI Data Trainer & Evaluator (Freelance), I assess and rate AI responses for factual correctness, tone, and relevance using defined rubrics. I conduct multilingual evaluation in English, Kiswahili, and Gusii, validating translation, cultural context, and naturalness. Additionally, I review image captions and conversational outputs for clarity, helpfulness, and alignment with educational best practices. • Evaluated AI outputs in three languages for linguistic accuracy • Rated educational content such as lesson plans and instructional prompts • Validated image captions for computer vision development • Assessed conversational AI responses for helpfulness and clarity

2025 - Present
Appen

Transcription Annotator — Jigglypuff Project

AppenAppenAudioAudioTranscriptionTranscription

As a Transcription Annotator on the Jigglypuff Project with Crowdgen by Appen, I review audio segmentations and provide accurate verbatim transcriptions through the ADAP platform. I use detailed guidelines to ensure consistency, accuracy, and high volume processing. My work directly supports AI-powered speech recognition model training pipelines. • Reviewed and segmented audio clips for transcription accuracy • Applied standardized annotation rules for linguistic and acoustic markers • Maintained productivity and quality benchmarks for large-scale datasets • Enhanced speech recognition datasets through human-labeled transcription

2024 - Present

Education

A

AIDRALabs

Advanced AI Data Trainer Mastery Certification, AI Data Training

Advanced AI Data Trainer Mastery Certification
2026 - 2026
C

Coursera / Google

Certificate in Project Management, Project Management

Certificate in Project Management
2024 - 2024

Work History

F

Family Development Organization

Education Program Manager

Kibidula
2023 - 2025
A

Apex Group of Schools

Education Operations & Teaching Lead

Nairobi
2019 - 2023