Malay Language LLM Evaluation Analyst
Review Malay and English language model responses, validate claims, solve reasoning tasks, and write detailed feedback. This remote contractor role requires 20+ hours per week.
Posted Jul 17, 2026
AI Training & Data Labeling
Hourly
Compensation
Worldwide
Eligibility
Entry
Experience
Sep 24, 2026
Posted
Open worldwide
About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for an experienced Moodle LMS Administrator to build realistic educational environments for AI model benchmarking. You will create and configure courses, manage cohorts and permissions, set up gradebooks and assessments, and define verification criteria to evaluate how well AI systems handle learning management system tasks.
What you will do
- Configure Moodle courses, user enrollment, role permissions, and gradebook calculations.
- Create realistic academic assets such as syllabi, quiz question banks, student cohorts, and SCORM modules.
- Record reference execution traces of course and grade calculation workflows.
- Define database and file-based verification checks for course, gradebook, quiz, cohort, and backup states.
- Review LMS workflows and task instructions for accuracy, clarity, solvability, and completeness.
Required skills
- Professional experience as an LMS Administrator, Instructional Designer, Academic Systems Coordinator, or EdTech Specialist.
- Mandatory hands-on experience administering Moodle.
- Strong knowledge of Moodle course settings, user enrollment, role permissions, and gradebook configuration.
- Understanding of Natural and Weighted Mean grade aggregation formulas.
- Knowledge of question-bank categorization, access restrictions, competency frameworks, cohort synchronization, and SCORM integration.
- Ability to create realistic academic course structures and assessment workflows.
- Ability to validate LMS permissions, grade calculations, and database states with technical precision.
- Clear written English for creating accurate academic task instructions.
Helpful background
- Experience with Moodle course backup and restore archives (.mbz and XML structures).
- Experience with Moodle REST Web Services API.
- Familiarity with Canvas LMS or Open edX.
- Knowledge of PostgreSQL, MySQL, or SQL-based database verification.
- Experience with academic systems benchmarking or LMS quality assurance.
Keep exploring
Review Malay and English language model responses, validate claims, solve reasoning tasks, and write detailed feedback. This remote contractor role requires 20+ hours per week.
Posted Jul 17, 2026
Review multi-turn LLM conversations and tool-use scenarios, improve model responses, and explain clear evaluation decisions. This remote contractor role requires English fluency, independent work, and PST overlap.
Posted Sep 16, 2026
Review and improve large language model performance on advanced mathematics, proofs, Python tasks, and Lean verification. This remote contractor role requires at least 20 hours per week, including daily Pacific Time overlap.
Posted Jul 20, 2026
Browse related job pages
Languages