Generative AI Output Evaluation & Annotation
No description provided.
Hire this AI Trainer
Sign in or create an account to invite AI Trainers to your job.
AI Content Reviewer & Language Specialist (Freelance/Remote). Brings 7+ years of professional experience across legal operations, contract review, compliance, and structured analysis. Core strengths include Label Studio, Scale AI-style, and Hugging Face ecosystem (transformers. Education includes Master of Science, University of Arizona - Scottsdale Center (2022) and Bachelor of Science, University of Arizona - Scottsdale Center (2017). AI-training focus includes data types such as Image and Text and labeling workflows including RLHF, Fine-tuning, and Fine Tuning.
No description provided.
Supported AI language model training by designing and refining prompts and evaluating generated outputs for coherence, factuality, and instruction-following. Performed multi-class text annotation to create supervised ML datasets used in NLP fine-tuning. Identified recurring model failure patterns and produced actionable written analyses for ML teams. • Used evaluation criteria to score prompt fidelity and response quality • Produced labeled data for supervised fine-tuning workflows • Documented failure patterns with reproducible, written methodology notes • Contributed to training pipelines through iterative prompt-and-eval cycles
Evaluated AI-generated text and image outputs for quality, coherence, and alignment with prompt intent, supporting iterative ML model improvement cycles. Ranked and compared multiple model responses per prompt using structured rubrics to select preferred outputs as RLHF-style preference data. Rewrote and refined responses to meet quality benchmarks and document failure modes for developers. • Assessed perceptual and semantic quality of text and image descriptions • Performed prompt engineering and refinement to improve specificity and controllability • Produced detailed written feedback on edge cases and systematic failures • Annotated and labeled large-scale text and image datasets for training and fine-tuning
Led public form annotation and structured data collection for AI training initiatives targeting multiple institutional domains. Captured, categorized, and validated screenshots of empty digital forms containing sensitive fields using a repeatable workflow on Safari for MacBook. Ensured high standards of data quality, approval, and privacy protection in remote, multilingual web environments. • Sourced and annotated web forms from government, finance, insurance, and employment websites • Verified presence of key sensitive data fields (e.g., SSN, VIN, passport) • Organized assets by locale, institution, and field priority • Enhanced data validation efficiency for AI data pipeline
Executed targeted data validation and digital form annotation for AI-related organizational projects. Conducted structured web-based validation of sensitive-field forms, ensuring compliance with project guidelines. Organized collected form screenshots, categorized metadata, and maintained high-quality documentation for AI data workflows. • Validated structure and completeness of public web forms • Logged URLs, structured metadata, and data fields • Flagged non-compliant forms for QA adjustment • Supported high-volume, remote data validation operations
Master of Science, Computer Science
Bachelor of Science, Statistics and Computer Science
Web Research and Data Collection Specialist
Web Research & Data Collection Specialist