Julius K.

Key Skills

Software

Scale AI

Remotasks

CloudFactory

Clickworker

Data Annotation Tech

Top Subject Matter

Large language model (LLM) output evaluation and human feedback labeling

Conversational AI dataset quality assurance and multilingual evaluation

Multimodal annotation with transcription validation and content safety QA

Top Data Types

Text

Audio

Image

Document

Top Task Types

RLHF

Transcription

Evaluation/Rating

Text Summarization

Bounding Box

Polygon

Segmentation

Text Generation

Question Answering

Data Collection

Prompt + Response Writing (SFT)

Freelancer Overview

Senior AI Annotation & Data Labeling Specialist at Scale AI (Remote). Brings 6+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Scale AI, Invisible Technologies, and Remotasks. Education includes Bachelor of Science in Information Technology, Kenyatta University (2021). AI-training focus includes data types such as Text and Audio and labeling workflows including RLHF, Evaluation, and Rating.

Labeling Experience

Senior AI Annotation & Data Labeling Specialist at Scale AI (Remote)

Scale AITextRLHF

Performed RLHF workflows to compare model responses, rank preferences, and assign quality scores while checking policy compliance. Annotated and evaluated LLM outputs for reasoning, factuality, summarization, instruction-following, and conversational behavior. Audited datasets for consistency, formatting compliance, and guideline adherence across high-volume production projects. • Response comparison and preference ranking • Quality scoring, policy evaluation, and safety checks • Hallucination and unsafe-response detection • Calibration exercises and contributor QA feedback

2023 - Present

AI Data Labeling & QA Specialist at Invisible Technologies (Remote)

Text

Delivered advanced data labeling, response evaluation, and quality assurance for conversational AI training datasets. Validated multilingual data for translation quality, contextual consistency, and annotation accuracy using detailed rubrics and standards. Conducted sentiment analysis, text classification, ranking, moderation review, and content filtering for enterprise dataset readiness. • Sentiment analysis, classification, and categorization • Response ranking and moderation/content filtering reviews • Speech-to-text transcription validation for grammar and formatting • Contributor calibration and documentation of recurring inconsistencies

2022 - 2022

Data Annotator & Transcription Reviewer at Remotasks (Remote)

RemotasksAudioTranscription

Completed annotation and transcription validation tasks covering text labeling, AI response review, and image-text evaluation for AI workflows. Reviewed speech-to-text outputs for timestamp accuracy, punctuation consistency, and recognition quality, ensuring dataset reliability. Supported AI moderation and content safety efforts using policy-sensitive datasets and performed quality assurance to improve annotation consistency. • Transcription validation (timestamps, punctuation, speech recognition quality) • AI moderation support on policy-sensitive data • Text labeling and categorization • QA checks to maintain dataset consistency

2021 - 2022

Education

Work History