For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
J
Jonathan R.

Jonathan R.

AI Product Architect / AI Evaluation Specialist — Kforce (AI response evaluation, rubric-based scoring, QA for AI traini

USA flagN/A, Usa

Key Skills

Software

Don't disclose
Other

Top Subject Matter

Generative AI evaluation and LLM quality assurance
Dataset annotation and quality review for AI training
Content moderation and labeling policy enforcement

Top Data Types

TextText
ImageImage
DocumentDocument

Top Task Types

Fine-tuningFine-tuning
ClassificationClassification

Freelancer Overview

AI Product Architect / AI Evaluation Specialist — Kforce (AI response evaluation, rubric-based scoring, QA for AI traini. Brings 5+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Don't disclose and Other. Education includes Bachelor of Science, Stanford University (2024). AI-training focus includes data types such as Text and Image and labeling workflows including Evaluation, Rating, and Fine-tuning.

Labeling Experience

AI Data Annotator & Quality Reviewer (Freelance) — Remote (NLP/CV dataset labeling and QA)

OtherTextTextFine-tuningFine-tuning

Annotated and reviewed datasets for machine learning and AI training across NLP and computer vision tasks. Performed QA checks on labeled data to ensure consistency and guideline compliance, including identification of labeling errors and missing or incorrect tags. Conducted structured reviews of AI-generated outputs for accuracy, relevance, and instruction adherence while delivering feedback to improve dataset reliability. • Labeled and reviewed data used for AI model training (NLP and CV) • Performed consistency and guideline compliance QA on labeled datasets • Detected classification issues, missing tags, and dataset inconsistencies • Produced feedback reports to improve annotation quality in remote workflows

2023 - Present

AI Product Architect / AI Evaluation Specialist — Kforce (AI response evaluation, rubric-based scoring, QA for AI training pipelines)

Don't discloseTextText

Performed AI response evaluation to benchmark model outputs against structured guidelines and rubrics. Conducted qualitative analysis to detect hallucinations, missing reasoning steps, and logical inconsistencies while ensuring compliance with AI safety and policy rules. Produced structured, evidence-based written rationales supporting grading and decision outcomes. • Evaluated accuracy, reasoning quality, and guideline adherence of LLM responses • Designed and applied evaluation rubrics for model performance improvement • Supported training workflows including dataset validation, prompt testing, and response grading • Collaborated with technical teams to improve alignment and output consistency

2024 - 2025

Content Moderator & Data Quality Reviewer — Remote (policy-based classification and dataset QA)

Don't discloseImageImageClassificationClassification

Moderated and classified user-generated content to enforce platform policies in a structured review workflow. Identified inappropriate or misleading content as well as incorrectly labeled items and escalated ambiguous or edge cases for further review. Applied moderation guidelines consistently across large-scale datasets while maintaining accuracy in fast-paced tasks. • Reviewed user-generated and image-based content for policy compliance • Identified incorrectly labeled or inappropriate content • Escalated ambiguous and edge-case items to additional review • Ensured consistent application of moderation rules across datasets

2022 - 2022

Education

S

Stanford University

Bachelor of Science, Artificial Intelligence

Bachelor of Science
2020 - 2024

Work History

N

N/A

Content Moderator and Data Quality Reviewer

N/A
2022 - Present
K

Kforce

AI Evaluation Specialist

Tampa
2024 - 2025