Simon R.

Key Skills

Software

Don't disclose

AWS SageMaker

Anno-Mage

Argilla

Clickworker

CrowdSource

CVAT

Data Annotation Tech

Datumbox

Datasaur

Datature

Doccano

Encord

Figure Eight

Google Cloud Vertex AI

Humanatic

iMerit

Kili Technology

Micro1

Mighty AI

Scale AI

Sloth

VoTT

V7 Labs

Other

Top Subject Matter

LLM-generated text quality

Safety Domain Expertise

and factuality (prompting, summaries, dialogues)

Top Data Types

Text

Image

Document

Top Task Types

Polygon

Classification

Point/Key Point

Cuboid

Text Generation

Question Answering

Entity (NER) Classification

Text Summarization

RLHF

Red Teaming

Polyline

Fine-tuning

Evaluation/Rating

Data Collection

Object Detection

Computer Programming/Coding

Transcription

Bounding Box

Function Calling

Segmentation

Prompt + Response Writing (SFT)

Freelancer Overview

Content & Prompt Engineering Analyst | BluePeak AI Research (2019–2021). Brings 10+ years of professional experience across complex professional workflows, research, and quality-focused execution. Core strengths include Don't disclose, Internal, and Proprietary Tooling. Education includes Master of Science, University of Washington (2021) and Bachelor of Science, Oregon State University (2019). AI-training focus includes data types such as Text and labeling workflows including Evaluation and Rating.

Labeling Experience

Software Engineer & AI Evaluation Specialist | NovaMind Technologies (2023–Present)

Don't discloseText

Evaluated over 5,000 AI-generated responses for factual accuracy, coherence, reasoning quality, tone, safety, and instruction-following across multiple LLM training projects. Designed and refined prompts and structured feedback workflows to improve model performance and engineering evaluation quality. Created SWE-bench-style coding tasks involving debugging, testing, code review, and implementation challenges across real-world software repositories. • Labeled/assessed responses across multiple rubric dimensions (factuality, coherence, safety, instruction-following) • Built structured feedback processes to guide model improvement • Authored coding tasks that function as training/evaluation data • Debugged, tested, and reviewed code to validate task and response quality

2023 - Present

Full Stack Software Engineer | BrightScale Labs (2021–2023)

Text

Assisted AI-related evaluation initiatives by analyzing generated code outputs, validating logic, and documenting model inconsistencies and edge cases. Supported QA-style validation of AI outputs to ensure correctness and usability of generated artifacts. Contributed to structured reporting of issues discovered during evaluation workflows. • Analyzed generated code outputs for correctness and edge cases • Validated logic and documented inconsistencies • Supported evaluation initiatives alongside engineering teams • Produced written documentation of model limitations

2021 - 2023

Content & Prompt Engineering Analyst | BluePeak AI Research (2019–2021)

Don't discloseText

Conducted evaluations of AI-generated text for fluency, creativity, factuality, bias detection, and alignment with user intent across multiple datasets. Performed detailed fact-checking and research across technical, scientific, and business subject areas to support AI safety and quality assurance initiatives. Delivered structured written feedback to improve nuanced language use and technical communication quality. • Developed high-quality prompts, summaries, and dialogues for training and evaluation workflows • Provided structured feedback to enhance AI understanding of language and coding explanations • Performed bias detection and alignment checks against user intent • Conducted research-driven verification of factual claims

2019 - 2021

Education

Work History