English (Australia) Audio Evaluator

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We connect skilled contributors with structured projects that shape how AI systems learn, and we help people build a unified portfolio of AI training work they control.

We focus on flexible, remote-friendly roles that allow contributors to grow skills and earn on their own terms. For this role, OpenTrain is the hiring and contracting organization.

About AI training and this work

AI training (also called data labeling or annotation) is the human work that teaches models how to understand and produce language and speech. Tasks include transcribing audio, writing and grading responses, and designing evaluation rubrics that ensure outputs meet quality standards.

This project targets contemporary Australian English in general consumer audio contexts — a direct way to influence how voice-enabled products and models understand Australian speakers.

The role

You will be an English (Australia) Audio Evaluator on a short-term, structured engagement focused on transcription, annotation, evaluation, and benchmark QA for audio AI. Work is project-based and contracted through OpenTrain.

Expect to produce precise written outputs, define grading criteria, review model responses, and help finalize benchmark datasets by resolving ambiguities and ensuring consistent, high-quality labels.

What you'll do

• Transcribe and analyze English (Australia) audio and video with detailed formatting and stylistic constraints.
• Write clear, accurate text outputs and support English-language documentation when needed.
• Develop evaluation rubrics and grading guidelines for correct, high-quality responses.
• Run model prompts, assess outputs against criteria for accuracy, completeness, fluency, and instructional clarity, and provide structured feedback.
• Support QA and review cycles, resolve ambiguities, and help improve task design and benchmark reliability.

Requirements

Candidates must meet the language and skills requirements listed below. This role is contractor, part-time work and is restricted to applicants located in Singapore.

• Native or near-native fluency in English (Australia), spoken and written.
• Strong familiarity with Australian English vocabulary, accents, slang, and contemporary usage.
• Experience transcribing and analyzing general consumer audio.
• Ability to write evaluation rubrics and grading guidelines, and to apply them consistently.
• Comfort reviewing model outputs for accuracy, completeness, fluency, and clarity.
• Strong writing, editing, and critical thinking skills.
• Background in transcription, annotation, localization, evaluation, or related research workflows is preferred.
• Location: Singapore only (per listing).

Hours, rate, and employment type

This is contractor, part-time work. Pay is USD $50 per hour.

The listing includes two time indications: a required commitment of 10–20 hours per week and a timeRequirement field of 20+ hours/week. Applicants should expect roughly a 20-hour weekly commitment; schedule flexibility may be possible within that range.

• Payment: PAY_PER_HOUR, USD $50/hr.
• Employment types: Contractor, Part-time.
• Labeling work: Audio transcription and evaluation ratings.

Who should apply

This project is a fit for communicators with strong Australian-English instincts who want hands-on experience shaping speech models. It’s suitable for people with transcription or annotation experience who can work independently and maintain consistent quality.

If you enjoy fine-grained language work — spotting register, intent, slang, and regional phrasing — and can write clear rubrics and feedback, you should apply.

• Ideal for intermediate contributors with prior transcription or annotation experience.
• Good fit for people seeking part-time, remote-friendly contractor work focused on language quality.

How to apply and next steps

Apply through your OpenTrain account. Create a profile, confirm your location and language fluency, and submit any sample transcription or evaluation work if requested.

Successful applicants will be onboarded to project instructions, given training materials and examples, and will participate in QA/review cycles to ensure consistency before datasets are finalized.