Lucia N.

Key Skills

Software

Labelbox

Micro1

Data Annotation Tech

Top Subject Matter

Data annotation

A/B testing-QA

Audio transcription

Top Data Types

Text

Audio

Video

Top Task Types

Evaluation/Rating

Question Answering

RLHF

Transcription

Fine-tuning

Freelancer Overview

I am a linguist specializing in AI evaluation, language quality, and discourse analysis. I currently work as an AI Trainer and reviewer, with experience evaluating and improving multimodal AI systems (VLMs), as well as LLMs, assessing model outputs, performing annotation tasks, and reviewing the work of other contributors to ensure quality and consistency. I have worked with audio transcription, video, image and text annotation and evaluation.

Labeling Experience

AI Trainer & Evaluator — VLM (Micro1)

Don't discloseVideo

Evaluated multimodal (audio + video) outputs across several evaluation dimensions as part of VLM training and assessment. Participated in creating and refining annotation guidelines and used review and adjudication to improve inter-annotator consistency. Conducted A/B testing and quality assurance to support reliable comparisons of model outputs. • Multimodal evaluation across defined axes • Guideline contribution and annotator adjudication • A/B testing for model output comparison • Quality assurance and consistency checks

2025 - Present

AI Trainer & Evaluator — LLM (Data Annotation Tech)

Don't discloseText

Performed evaluation-oriented annotation for LLM-related outputs across multiple assessment axes. Developed rubrics, trained annotators, and adjudicated labeling to improve reliability and consistency. Ran A/B testing and executed quality assurance checks to validate model output comparisons. • Rubric creation for LLM evaluation • Annotator training, review, and adjudication • A/B testing and comparative evaluation • QA and consistency verification

2025 - Present

Data Annotator (Audio) — Alignerr

Don't discloseAudioTranscription

Trained and evaluated audio components for multimodal and model outputs by overseeing time alignment and speaker-turn labeling. Labeled single- and multi-speaker conversational audio using project-specific transcription conventions and identified salient audio phenomena. Supported consistency through guideline contributions and adjudication decisions. • Time-aligned transcription and speaker turn labeling • Labeled salient audio phenomena • Reviewed and adjudicated annotator work for consistency • Conducted quality assurance

2025 - 2025

Research Fellow (Discourse Analysis) - Universidad de Buenos Aires

LabelboxVideoTranscriptionEntity (NER) Classification

CONICET Research Fellow conducting discourse analysis research and academic contributions at the university level. Responsibilities included corpus data collection, analysis, and drafting research outputs for publication and presentation. The role required strong research design skills, interdisciplinary collaboration, and the ability to communicate findings in academic venues and publications. • Managed corpus data collection and annotation workflows for Discourse Analysis projects • Analyzed linguistic data and drafted research outputs for dissemination • Presented results at symposiums and supported scholarly publishing activities • Peer reviewed academic articles and wrote book reviews in linguistics

2023 - 2025

CONICET Research Fellow — Universidad de Buenos Aires

Don't discloseAudioTranscription

Managed and contributed to corpus data collection and annotation for discourse analysis projects. Conducted transcription and time alignment for conversational audio, labeling speaker turns and salient audio phenomena using project-specific transcription conventions. Supported annotation reliability through guideline contributions, reviewer/adjudication work, and quality assurance processes. • Corpus data collection and annotation management • Conversational audio transcription and time alignment • Speaker-turn and salient-audio labeling • Guideline, review/adjudication, and QA support

2023 - 2025

Education

Work History