Paul B.

Key Skills

Software

Appen

Other

Scale AI

Clickworker

Labelbox

Top Subject Matter

NLP and LLM evaluation (prompt-response quality assessment)

Physics reasoning evaluation in NLP datasets

Mathematics reasoning evaluation for LLM training

Top Data Types

Text

Top Task Types

Classification

RLHF

Freelancer Overview

AI Data Annotator – Appen Canada (Remote). Professional background includes roles such as N/A. Core strengths include Appen, Other, and Scale AI. Education includes Bachelor of Science, University of Manitoba. AI-training focus includes data types such as Text and labeling workflows including Evaluation, Rating, and Classification.

Labeling Experience

AI Data Annotator – Appen Canada (Remote)

AppenText

Evaluated AI-generated outputs to assess relevance, accuracy, and coherence for LLM training pipelines. Performed ranking and grading to improve model alignment with human expectations and maintain guideline-based quality. Ensured high performance by following strict annotation instructions and delivering consistent results at scale. • Assessed LLM outputs for relevance, accuracy, and coherence • Ranked and graded responses to match human expectations • Maintained 98%+ quality accuracy across ongoing work • Followed strict annotation guidelines and deadlines

2023 - Present

Physics Content Reviewer – Cohere Canada (Remote)

OtherText

Reviewed AI-generated physics explanations and scientific reasoning for correctness and coherence. Assessed mechanics and electricity problem-solving outputs within NLP systems, identifying logical inconsistencies. Corrected inaccurate scientific interpretations and contributed to dataset reliability and model performance improvements. • Validated physics reasoning for accuracy and coherence • Assessed mechanics/electricity problem-solving outputs • Identified inconsistencies and corrected incorrect interpretations • Supported dataset reliability through collaborative review

2022 - 2023

Data Annotation Specialist – Clickworker (Remote)

ClickworkerTextClassificationRLHF

Completed diverse text annotation tasks including text classification and sentiment analysis. Reviewed and corrected peer annotations to ensure dataset integrity and reliability. Consistently contributed as a top-performing contributor while adapting to new tools and project requirements. • Annotated text for classification and sentiment • Performed peer review and corrections for integrity • Ranked among top contributors • Adapted to new annotation tools and requirements

2021 - 2022

Mathematics AI Evaluator – Scale AI Canada (Remote)

Scale AIText

Evaluated mathematical reasoning and problem-solving accuracy in AI-generated responses for training datasets. Validated algebraic, statistical, and quantitative outputs and performed comparative ranking to improve precision. Maintained high-quality annotation standards by adhering to project guidelines and deadlines. • Checked algebraic/statistical/quantitative correctness • Conducted comparative ranking for logical consistency • Evaluated responses for math reasoning accuracy • Followed strict guidelines for quality and timeliness

2021 - 2022

N/A - N/A

LabelboxTextClassificationRLHF

No non–data-labeling, non–AI training/tutoring roles were found in the provided resume text. The listed positions are primarily focused on AI/data annotation, evaluation, and training-related tasks. As a result, there is no eligible standard work experience to structure into a resume entry. • Excluded roles include data annotator and AI evaluator positions. • Excluded roles include physics content reviewer focused on AI output validation. • Excluded roles include mathematics and general data annotation specialist responsibilities. • No alternative qualifying employment details were present in the text.

Not specified

Education

Work History