Aryan Y.

Key Skills

Software

Scale AI

Top Subject Matter

LLM evaluation and response quality assessment (AI training/evaluation)

Security automation and evaluation tooling

Top Data Types

Text

Top Task Types

Red Teaming

Freelancer Overview

AI Evaluator — Outlier AI (Scale AI Partner). Brings 2+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Scale AI, Internal, and Proprietary Tooling. Education includes Bachelor of Technology, National Institute of Technology, Patna (2029). AI-training focus includes data types such as Computer Code, Programming, and Text and labeling workflows including Evaluation, Rating, and Red Teaming.

Labeling Experience

AI Evaluator - Outlier AI

Scale AIText

Developed a multi-phase LLM response evaluation pipeline to score outputs across multiple rating dimensions. Designed STEM prompt-creation workflows with source exclusion and multi-stage source verification to improve response reliability. Validated generation quality using go-to-first-answer checks via live web search. • Built an 8-phase LLM evaluation pipeline with anti-hallucination gates • Designed prompt-creation workflows with paywalled-source exclusion and verification • Ran GTFA validation using live web search for difficult cases • Applied LLM evaluation and web validation techniques to improve model outputs

2026 - Present

AI Evaluator — Outlier AI (Scale AI Partner)

Scale AI

Built an LLM response evaluation pipeline to score generated answers across multiple criteria. Implemented hallucination-gating steps and verification workflows to improve evaluation reliability. Performed GTFA (go-to-first-answer) validation using live web search to identify high-difficulty or unsupported outputs.• Created an 8-phase evaluation process with 5 rating dimensions and 6 anti-hallucination gates.• Designed STEM prompt-creation workflows that excluded paywalled sources.• Added 5+ source verification requirements for evaluated responses.• Validated responses by checking findings against live web results.

2025 - Present

Security Automation Engineer — Institute Alterna

Red Teaming

Automated cybersecurity incident-response workflows and supported security testing activities against web targets. Conducted vulnerability assessments and penetration tests as part of security operations tooling. Built internal monitoring dashboards and access-control tooling to reduce manual triage overhead.• Automated incident-response workflows to streamline triage.• Ran vulnerability assessments and penetration tests on web targets.• Implemented internal monitoring dashboards for security operations visibility.• Developed access-control tooling to support secure operations.

2025 - 2025

Education

Work History