Nikhil N.

Key Skills

Software

No software listed

Top Subject Matter

LLM post-training / annotation quality assurance

Operations data compilation and validation (stakeholder/partnership records)

Top Data Types

Text

Document

Top Task Types

Data Collection

Classification

RLHF

Evaluation/Rating

Computer Programming/Coding

Freelancer Overview

Ethara AI — Associate, LLM Post-Training. Brings 3+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Internal, Proprietary Tooling, and Excel. Education includes Bachelor of Science (Research) in Mathematics, Shiv Nadar Institution of Eminence (2026), a minor in economics with a thesis is applied econometrics, machine learning, deep learning and statistical evaluation frameworks for time series. AI-training focus includes data types such as Text and Document and labeling workflows including Evaluation, Rating, and Data Collection.

Labeling Experience

LLM Evaluation Associate (Post-Training) - Ethara AI

Text

Owned prompt-response evaluation by applying accuracy, relevance, and coherence rubric scoring and translating results into structured quality outputs. Performed structured data validation and quality checks across high-volume annotation pipelines while maintaining consistency and reliability in evaluation judgments. Calibrated evaluation criteria based on Quality Reviewer feedback in a production, metrics-driven environment with strict SLA and KPI expectations. • Evaluated LLM outputs using predefined rubrics and systematic scoring. • Conducted data validation and quality benchmarking to ensure correctness. • Maintained accuracy and SLA/KPI adherence in high-throughput workflows. • Coordinated iterative calibration using reviewer feedback to improve reliability.

2026 - Present

Ethara AI — Associate, LLM Post-Training

Text

Conducted prompt-response evaluation using predefined accuracy, relevance, and coherence rubrics. Performed structured data validation and quality checks across high-volume annotation pipelines to ensure label consistency and reliability. Maintained KPI/SLA adherence by translating ambiguous evaluation criteria into consistent decisions and calibrating with Quality Reviewer feedback. • Evaluated LLM outputs against rubric-based scoring criteria • Validated annotation data for quality, coherence, and consistency • Performed high-volume quality assurance in production settings • Calibrated evaluation judgments via reviewer feedback

2026 - Present

Ace Experiences — Summer Intern, Operations & Partnerships

DocumentData Collection

Owned and maintained structured stakeholder databases for operations supporting partnerships and sponsorships. Led creation of reusable onboarding documentation to standardize information capture and data completeness. Coordinated remote interns to compile, validate, and deliver partnership data with quality checks and timeline ownership. • Built stakeholder databases for sponsors, vendors, and partnerships • Designed reusable onboarding documentation framework • Supervised remote intern data compilation and validation • Ran quality checks and managed delivery timelines

2024 - 2024

Education

Work History