Akila A.

Key Skills

Software

Telus

Don't disclose

Other

Top Subject Matter

LLM training data annotation and evaluation (content quality, safety, and ranking)

AI agent instruction writing and LLM output evaluation for RLHF-style tuning

Legal Services & Contract Review

Top Data Types

Image

Text

Video

Document

Top Task Types

Entity (NER) Classification

Evaluation/Rating

Fine-tuning

Prompt + Response Writing (SFT)

Question Answering

RLHF

Classification

Freelancer Overview

AI Content Writer (Data Annotator/Evaluator for LLM outputs). Brings 4+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Other. Education includes Master of Science, University of Madras (2022) and Diploma, University of Madras (2022). AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and RLHF.

Labeling Experience

Business Analyst (Freelance) - Turing

TextRLHF

Served as a freelance business analyst translating user requirements into structured instructions for AI agents. Evaluated AI-generated outputs against business criteria such as task completion, factual accuracy, and response experience. Documented evaluation reasoning to support RLHF-style pipelines and iterative workflow improvements. • Defined agent goals, sub-goals, guidelines, and execution constraints • Performed A/B comparative analysis to assess quality, consistency, and requirement alignment • Rated outputs with data-driven feedback and identified gaps for improvement • Prepared structured evaluation notes to improve reliability of AI-driven workflows

2026 - 2026

Binary Preference and Rating

Don't discloseAudioEmotion RecognitionEvaluation/Rating

The project involved evaluating AI-generated audio responses to ensure high-quality output and natural rendering aligned with user prompts. My primary responsibility was to compare and rate two audio responses based on predefined criteria such as clarity, tone, fluency, and contextual accuracy. This process aimed to improve the overall quality and performance of AI-driven voice systems.

2025 - 2025

AI Content Writer - Amazon

TextClassification

Worked as an AI content writer evaluating and ranking AI responses across multiple tasks for quality and compliance. Conducted data labeling and annotation to support LLM training, while also detecting edge cases, hallucinations, bias, and safety risks. Produced clear rationales for rankings to support reinforcement learning and ongoing model optimization. • Evaluated coherence, factual accuracy, and guideline adherence in AI outputs • Performed ranking and annotation for classification, summarization, moderation, and rewriting tasks • Reviewed outputs for safety risks and ensured compliance with internal standards • Maintained accuracy and productivity while supporting multi-domain research and reference building

2024 - 2025

AI Content Writer (Data Annotator/Evaluator for LLM outputs)

OtherText

Performed data labeling and annotation for LLM training across multiple task types including ranking, content moderation, classification, summarization, and rewriting. Evaluated AI-generated responses by rating quality, coherence, factual accuracy, and guideline adherence while identifying edge cases, hallucinations, bias, and safety risks. Produced written rationales supporting reinforcement learning and model optimization decisions. • Labeled response pairs and assigned quality/ranking judgments • Moderated content by flagging unsafe or non-compliant outputs • Detected hallucinations, bias, and safety risks against internal standards • Authored rationales for ranking decisions for RLHF-style improvement

2024 - 2025

Education

Work History