Keshav Y.

Key Skills

Software

Appen

Clickworker

Axiom AI

AWS SageMaker

CrowdSource

Top Subject Matter

AI/LLM Quality Evaluation and Error Analysis

Top Data Types

Text

Image

Computer Code Programming

Top Task Types

RLHF

Evaluation/Rating

Computer Programming/Coding

Fine-tuning

Text Summarization

Freelancer Overview

LLM Output Evaluator – Quality Assurance for Question Answering Systems. Core strengths include Internal and Proprietary Tooling. Education includes Bachelor of Technology, The NorthCap University (2022). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

LLM Output Evaluator – Quality Assurance for Question Answering Systems

Text

Served as the primary evaluator for large language model outputs in UPSC exam and medical question-answering AI projects. Identified factual inaccuracies, model hallucinations, and lack of source grounding by reviewing LLM text responses. Applied consistent criteria for output evaluation and provided structured feedback for iterative improvement. • Used tracing and prompt engineering to test model output reliability. • Evaluated groundedness of responses using source documents and retrieval mechanisms. • Developed and documented steps for systematic model assessment in high-stakes domains. • Worked with an internal review workflow and LangSmith for tracking evaluations.

2024 - Present

Education

Work History