Anthropic LLM Model Training
Lead a team of data annotators in the document reading and context extraction within the guidelines of the SOP from the client
Hire this AI Trainer
Sign in or create an account to invite AI Trainers to your job.
Turing — Data Annotation Specialist (Nov 2024 – Mar 2025, Phase 1). Brings 9+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal and Proprietary Tooling. Education includes Master of Science, Keller Graduate School of Management (2014) and Bachelor of Engineering, Covenant University (2010). AI-training focus includes data types such as Text and labeling workflows including Fine-tuning, Evaluation, and Rating.
Lead a team of data annotators in the document reading and context extraction within the guidelines of the SOP from the client
Advanced to Annotation Project Manager overseeing end-to-end delivery of multiple concurrent annotation programmes across model families and data types within the Turing ecosystem. Managed workflows spanning data collection, annotation, quality assurance, and validation pipelines, ensuring visibility from raw ingestion to training-ready dataset delivery. Coordinated cross-functional stakeholders and established operational standards to improve throughput predictability, reduce data rejection rates, and raise overall programme quality. • Program-level management across concurrent annotation workstreams • Scheduling, tracking progress, and reporting quality/throughput metrics • Workflow design, task allocation, and escalation processes • Cross-functional coordination with data engineering and model stakeholders
Worked as an Annotation Quality Assurance (QA) Reviewer to audit and validate LLM training datasets before ingestion into model pipelines. Measured and monitored inter-annotator agreement (IAA), identified systematic labeling errors and edge cases, and supported guideline calibration through targeted feedback and re-training sessions. Developed and refined annotation guidelines and quality rubrics in response to evolving model requirements and observed failure modes, acting as a quality gate for validated, high-confidence data. • Auditing outputs against labeling guidelines and escalations • IAA measurement and annotator calibration • Guideline and rubric refinement based on error analysis • Structured written feedback to reduce rework cycles
Served as a Data Annotation Specialist performing high-volume, high-accuracy LLM dataset annotation for training programmes across multiple model families. Labeled prompt-response pairs for instruction-following quality and correctness, collected preference data via RLHF-style ranking rubrics, and annotated conversational and dialogue data for coherence and intent/slot tasks. Reviewed code generation outputs for correctness, efficiency, and documentation quality to support LLM coding capability development. • Text classification across single-label and multi-label taxonomies • Instruction & response evaluation for safety, helpfulness, and policy compliance • Preference & ranking (RLHF) rating to produce training preference data • Conversational/dialogue annotation and code evaluation
Professional Certificate, Strategic Decision and Risk Management
Master of Science, Network and Communications Management
Lead Technical Product Delivery (AI/ML & Open Banking)
Head of Product (Cene - AI-Enhanced Event Platform)