JavaScript TypeScript AI Model Evaluation Developer

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this role and the #1 platform for finding and building careers in AI training and data labeling. Create a free OpenTrain account to build your profile and apply in minutes.

This opportunity combines software development with practical AI training work, giving you experience that can strengthen your AI training portfolio.

About AI Training and Model Evaluation

AI training is the human side of building artificial intelligence. Contributors prepare datasets, review model outputs, write and rank responses, and provide feedback that helps modern AI systems become more accurate and useful.

In this role, your programming expertise will support coding evaluation, supervised fine-tuning, and reinforcement learning with human feedback. The work is remote and offers flexible part-time scheduling within the assignment requirements.

The Role

OpenTrain AI is seeking a JavaScript and TypeScript AI Model Evaluation Developer for a remote contractor assignment lasting one month. You will combine full-stack development with hands-on model training and evaluation.

The role requires at least four hours per day and 20 hours per week, with options to work 20, 30, or 40 hours weekly. Four hours of overlap with Pacific Time is required.

• Remote contractor assignment
• One-month contract duration
• 20, 30, or 40 hours per week
• At least four hours per day and 20 hours per week
• Four hours of overlap with Pacific Time
• Worldwide opportunity
• English-language work

What You'll Do

You will develop reliable software and apply structured judgment to AI model outputs. Your work will help improve training data, evaluation quality, and the technical accuracy of model responses.

• Design, develop, and maintain readable, reusable, secure, and stable JavaScript or TypeScript code.
• Conduct model evaluations, benchmark performance, analyze results, and recommend improvements.
• Evaluate and rank responses to user queries across diverse domains using established criteria.
• Write clear explanations and technical rationales for evaluation decisions.
• Create and maintain high-quality datasets for supervised fine-tuning.
• Support reinforcement learning with human feedback and reward-model refinement.
• Produce and refine model responses for clarity, relevance, and technical accuracy.
• Review code and documentation and provide constructive feedback.

Required Skills and Experience

This opportunity is listed at the entry level, while the assignment requires extensive practical JavaScript or TypeScript experience. Candidates should be able to build modular web applications and assess technical AI outputs with clarity and consistency.

• Extensive experience with JavaScript or TypeScript, including strong command of ES6 syntax and conventions.
• Strong understanding of at least one of Node.js, Nest.js, React, Angular, or Vue.
• Experience developing modular web applications with scalable architectures.
• Ability to write organized, maintainable, correct, secure, and clearly annotated code.
• Ability to evaluate and rank AI model responses against defined criteria.
• Ability to write clear technical rationales for evaluation decisions.
• Ability to create supervised fine-tuning datasets and support RLHF.
• Engineering or computer science degree, or equivalent experience.
• Excellent spoken and written English communication skills.
• Docker experience and familiarity with software quality assurance or test planning are valuable.

Who Should Apply

Apply if you are a JavaScript or TypeScript developer who enjoys combining software engineering with structured analysis of AI behavior. The role is suited to someone who can move between writing production-quality code, reviewing technical responses, documenting reasoning, and collaborating with researchers and annotators.

You should be comfortable following evaluation criteria, identifying weaknesses in model responses, and contributing constructive feedback during code and documentation reviews.

• JavaScript or TypeScript developers with full-stack web application experience
• Engineers who can work with scalable, modular architectures
• Candidates interested in coding datasets, model evaluation, fine-tuning, and RLHF
• Clear technical communicators who can explain evaluation decisions
• Contributors available for the required weekly schedule and Pacific Time overlap

Apply Through OpenTrain

OpenTrain brings together opportunities in AI training and data labeling, where people help shape how cutting-edge AI systems work. Create a free account, build your profile, and apply through OpenTrain for this remote contractor assignment.

• Review the role requirements and engagement schedule.
• Create or update your free OpenTrain profile.
• Apply in minutes through OpenTrain.