For employers

Hire this AI Trainer

Sign in or create an account to invite AI Trainers to your job.

Invite to Job
D
Dr. K.

Dr. K.

AI Output Evaluation and Rubric Design

USA flagN/A, Usa

Key Skills

Software

Don't disclose

Top Subject Matter

Education Domain Expertise
school social work
child welfare

Top Data Types

TextText
DocumentDocument

Top Task Types

ClassificationClassification

Freelancer Overview

AI Output Evaluation and Rubric Design. Brings 17+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Don't disclose. Education includes Doctor of Philosophy, Old Dominion University (2015) and Master of Education, Old Dominion University (2008). AI-training focus includes data types such as Text and Document and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

Subject Matter Expert (AI Output Evaluation & Rubric Design) - Self-Employed

DocumentDocument

Designed prompts and developed atomic and binary rubric criteria to evaluate AI-generated outputs for accuracy and domain appropriateness. Authored and applied quality rating standards across education, school social work, child welfare, and counseling scenarios. Produced defensible written rationales supporting each rating decision. • Authored rubric criteria for AI output evaluation across multiple domains • Evaluated factual accuracy and professional-domain appropriateness of AI-generated content • Designed prompt sets to surface model failure modes for quality assessment • Produced clear written rationale for ratings to support transparent decisions

2024 - Present

AI Output Evaluation and Rubric Design

Don't discloseTextText

Evaluated AI-generated outputs using structured criteria for factual accuracy, quality, and domain appropriateness. Authored atomic and binary rubric criteria and designed prompts to surface model failure modes in educational and child/family service contexts. Produced clear written rationales for each rating decision. • Assessed AI responses across school social work, child welfare, and counseling scenarios • Applied rubric-based standards to rate accuracy and overall quality • Reviewed outputs for domain fit and contextual appropriateness • Iterated prompts and criteria to expose common model failure patterns

2024 - Present

Subject Matter Expert, National Counselor Examination (NBCC)

Don't discloseTextTextClassificationClassification

Developed and reviewed standardized assessment items for a national licensure exam using structured criteria. Judged item validity, clarity, and defensibility as part of quality labeling of test questions. Ensured each item met defensible standards before use. • Evaluated item validity against structured criteria • Reviewed clarity and readability of assessment prompts • Assessed defensibility of scoring or interpretation • Refined standardized assessment items for national exam use

2024 - 2024

Education

O

Old Dominion University

Doctor of Philosophy, Counselor Education and Supervision

Doctor of Philosophy
2011 - 2015
O

Old Dominion University

Master of Education, School Counseling

Master of Education
2005 - 2008

Work History

S

Self-Employed

Subject Matter Expert (AI Output Evaluation & Rubric Design)

N/A
2024 - Present
N

NBCC

Subject Matter Expert (National Counselor Examination)

N/A
2024 - 2024