Nicole J.

Key Skills

Software

Other

Top Subject Matter

Artificial Intelligence – LLM Evaluation & Data Annotation

Healthcare – Medical Interpretation & Clinical Communication

Government, Public Policy & International Relations

Top Data Types

Text

Image

Top Task Types

Classification

Text Generation

Text Summarization

Evaluation/Rating

Prompt + Response Writing (SFT)

Freelancer Overview

Bilingual AI Trainer with professional experience at Outlier AI, specializing in data annotation, classification, response evaluation, quality assurance, and multilingual dataset review. Experienced in assessing AI-generated content for accuracy, relevance, instruction-following, safety, and linguistic quality in both English and Spanish. Skilled in applying annotation guidelines, identifying reasoning errors, and providing human feedback to improve large language model (LLM) performance. In addition to AI training, I bring strong analytical and research skills developed through my academic background in International Relations. My experience working with multilingual data, content evaluation, and quality control allows me to contribute effectively to AI training, RLHF, prompt evaluation, and data labeling projects requiring accuracy, consistency, and critical thinking.

Labeling Experience

Multilingual AI Response Evaluation – Outlier AI

TextEvaluation/Rating

Evaluated and ranked AI-generated responses across multilingual datasets in English and Spanish. Assessed outputs based on accuracy, relevance, coherence, reasoning quality, factual consistency, and compliance with user instructions. Applied detailed evaluation rubrics and project guidelines to identify high-quality responses and support model alignment objectives. Contributed to the improvement of large language models by providing structured human feedback, detecting hallucinations, identifying linguistic errors, and analyzing complex reasoning tasks. Maintained high standards of quality and consistency while working on large-scale AI evaluation projects in a remote environment.

2024 - 2025

AI Trainer & Data Annotation Specialist – Outlier AI

TextClassification

Worked on AI training and data annotation projects for large language models (LLMs) through Outlier AI. Responsibilities included evaluating and ranking AI-generated responses, performing text classification and annotation tasks, identifying factual inaccuracies and reasoning errors, and providing human feedback to improve model performance. Applied detailed project guidelines to ensure consistency, accuracy, and quality across multilingual datasets in English and Spanish. Contributed to reinforcement learning from human feedback (RLHF) workflows by assessing instruction-following, relevance, safety, and linguistic quality of model outputs. Maintained high-quality standards while working independently in a remote environment and handling large-scale annotation projects with strict accuracy requirements.

2024 - 2025

Education

Work History