AI Training Specialist / Data Annotator (present)
Evaluated and refined LLM-generated outputs using multi-criteria rubrics covering safety, reasoning quality, truthfulness, and style to improve downstream model performance. Designed and ran multi-turn prompt stress tests with adversarial red-teaming to surface edge cases, hallucinations, and security vulnerabilities. Annotated large-scale textual and code-related datasets with advanced alignment scoring schemas aligned to expert benchmarks and used outcomes to support SFT-ready human demonstrations. • Safety and alignment evaluation of model generations • Adversarial red-teaming and edge-case identification • Text/code annotation with alignment scoring against benchmarks • Curation of high-quality human demonstration data for SFT