For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
M
Mercy M.

Mercy M.

AI Content Evaluation Specialist (Freelance / Independent Projects) — AI Evaluator (Remote)

Kenya flagNairobi, Kenya

Key Skills

Software

ClickworkerClickworker
CloudFactoryCloudFactory
iMeritiMerit
Micro1
RemotasksRemotasks
TelusTelus
TolokaToloka

Top Subject Matter

AI content evaluation and prompt-response assessment
Content quality analysis and AI-generated draft evaluation
LLM output benchmarking and prompt optimization

Top Data Types

TextText
ImageImage
Computer Code ProgrammingComputer Code Programming

Top Task Types

Prompt + Response Writing (SFT)Prompt + Response Writing (SFT)
ClassificationClassification
Evaluation/RatingEvaluation/Rating
Computer Programming/CodingComputer Programming/Coding
Text GenerationText Generation
Question AnsweringQuestion Answering
SegmentationSegmentation

Freelancer Overview

AI Content Evaluation Specialist (AI Evaluator) — Mutia (Freelance/Independent Projects). Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Other. Education includes Bachelor of Technology in Electrical Engineering, Technical University Of Kenya (2023) and High School Diploma, Pangani Girls National School (2018). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

AI Content Evaluation Specialist (Freelance / Independent Projects) — AI Evaluator (Remote)

OtherTextText

Evaluated AI-generated text responses from ChatGPT, Gemini, and Perplexity for accuracy, coherence, and tone consistency. Designed and tested prompts to check model behavior across technical, conversational, and creative contexts and documented structured findings. Scored content quality and alignment with user intent using rubric-based methods and provided feedback for improvement. • Conducted bias, factual error, and logical gap detection in model outputs. • Performed side-by-side comparisons across AI tools to assess strengths, weaknesses, and reliability. • Flagged outputs that conflicted with user intent or contained inconsistencies. • Produced structured recommendations to guide prompt and response refinement.

2024 - Present

AI Output Benchmarking Project / Prompt Optimization Project (Project Experience)

Don't discloseTextTextPrompt + Response Writing (SFT)Prompt + Response Writing (SFT)

Developed evaluation criteria and compared responses from ChatGPT, Gemini, and Perplexity across multiple domains. Produced structured reports identifying performance gaps and improvement areas based on rubric dimensions. Iterated prompt strategies to address observed weaknesses such as hallucination, vagueness, and bias. • Defined scoring dimensions for accuracy, tone, depth, and bias • Benchmarked LLM outputs using side-by-side comparisons • Authored improvement recommendations derived from evaluation results • Applied prompt optimization cycles to improve response clarity and relevance

2023 - 2024

Content Quality Analyst (Independent Projects) (Remote)

OtherTextText

Reviewed and edited written AI-generated drafts for clarity, grammar, tone, and audience alignment. Performed fact-checking and source validation to ensure accuracy, then flagged inconsistencies and ambiguous language. Maintained detailed documentation of evaluation processes and results for ongoing quality assurance. • Refined AI outputs to meet professional communication standards. • Evaluated factual accuracy and flagged hallucination-like issues. • Provided structured edits and feedback for better readability and coherence. • Ensured consistency in tone, bias considerations, and language quality across outputs.

2023 - 2024

Education

T

Technical University Of Kenya

Bachelor of Technology in Electrical Engineering, Electrical Engineering

Bachelor of Technology in Electrical Engineering
2019 - 2023
P

Pangani Girls National School

High School Diploma, General Education

High School Diploma
2014 - 2018

Work History

M

Mutia

AI Content Evaluation Specialist (Freelance)

Nairobi
2024 - Present
M

Mutia Mercy

Content Quality Analyst (Independent Projects)

Nairobi
2023 - 2024