Integration Developer For AI API Evaluation

About OpenTrain

OpenTrain AI is the hiring and contracting organization for this remote AI training role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping people discover projects, build experience, and apply in minutes. Creating an OpenTrain account is free.

• Contractor and part-time opportunity
• Remote work available worldwide, subject to location restrictions
• Expected commitment of 20+ hours per week
• Hourly pay range of $15 to $45 USD

About AI Training Work

AI training is the human side of building modern artificial intelligence. Specialists create realistic examples, review model-generated work, and provide structured feedback that helps AI systems produce more accurate and useful results.

In this role, your API integration knowledge will help train and evaluate systems that reason about business applications, data transfer, function calling, workflows, and interoperability.

• Contribute to cutting-edge AI development
• Apply practical technical expertise to model evaluation
• Work remotely with flexible, part-time scheduling

The Role

OpenTrain AI is seeking an Integration Developer and API Specialist to train and evaluate AI systems in API integration and interoperability scenarios. You will generate challenging prompts, assess AI-generated integration plans and payloads, and review workflows for reliable data transfer and error handling.

Typical scenarios involve connecting CRMs, advertising platforms, email tools, and databases such as Airtable, Google Sheets, and Notion through REST APIs and webhooks. This is an intermediate-level contractor role for candidates with hands-on integration experience and strong technical reading skills.

• Intermediate experience level
• 20+ hours per week
• Data type: text
• Core subject matter: APIs, webhooks, and systems connectivity

What You'll Do

You will combine software integration experience with careful evaluation and annotation to determine whether AI-generated solutions are technically sound, complete, and robust.

• Generate prompts that challenge AI models to design business-system integrations
• Evaluate AI-generated integration plans, payloads, and workflows
• Review REST API and webhook designs for interoperability and reliable data transfer
• Assess data mapping, schema validation, and data pipeline decisions
• Check handling of API errors, data issues, and troubleshooting scenarios
• Evaluate real-time and batch processing tradeoffs
• Perform text annotation, evaluation, rubric-based quality assurance, fine-tuning, RLHF, and function-calling assessment
• Review technical solutions involving CRMs, ad platforms, email tools, Airtable, Google Sheets, and Notion

Requirements

You should have practical experience building integrations between SaaS tools and business systems. The work requires the ability to interpret technical API documentation, reason about system connectivity, and independently assess the quality of AI-generated technical outputs.

The requirements also include experience evaluating LLM outputs for legal reasoning quality, along with hands-on text annotation, evaluation, or rubric-based QA experience.

• Proven hands-on experience integrating REST APIs and webhooks
• Experience connecting SaaS tools and business systems
• Ability to read and interpret technical API documentation
• Knowledge of data mapping, schema validation, and data pipelines
• Understanding of real-time and batch processing tradeoffs
• Strong troubleshooting skills for API failures and data issues
• Experience evaluating LLM outputs for legal reasoning quality
• Hands-on text annotation, evaluation, or rubric-based QA experience
• English proficiency at B2 level or higher
• Ability to work independently
• Strongly preferred: examples of complex system integrations

Application Materials

Submit a CV in English that clearly indicates your level of English proficiency. Include your email address and phone number with your application.

• CV must be written in English
• State your English proficiency level
• Include an email address
• Include a phone number

Location Eligibility and Compensation

The opportunity is listed as worldwide, but acquisition is restricted in the following locations: Iran, Cuba, North Korea, Syria, Sudan, Venezuela, Myanmar, Russia, Belarus, Palestine, Switzerland, China, Taiwan, and Kenya.

It is also restricted in these U.S. states: Alaska, Arkansas, California, Connecticut, Delaware, Georgia, Hawaii, Illinois, Indiana, Kansas, Louisiana, Maine, Maryland, Massachusetts, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, Ohio, Oregon, Tennessee, Utah, Vermont, Washington, and West Virginia.

Additional restricted territories and locations are Antarctica, Aruba, Åland Islands, Saint Barthélemy, Bonaire, Sint Eustatius and Saba, Bouvet Island, Cocos (Keeling) Islands, Democratic Republic of the Congo, Cook Islands, Christmas Island, Western Sahara, Falkland Islands (Malvinas), French Guiana, Guadeloupe, South Georgia and the South Sandwich Islands, Heard Island and McDonald Islands, British Indian Ocean Territory, Northern Mariana Islands, Martinique, New Caledonia, Norfolk Island, Niue, French Polynesia, Saint Pierre and Miquelon, Pitcairn, Réunion, Saint Helena, Ascension and Tristan da Cunha, Svalbard and Jan Mayen, Sint Maarten (Dutch part), French Southern Territories, Tokelau, United States Minor Outlying Islands, Holy See, Virgin Islands (British), Wallis and Futuna, and Mayotte.

The listed compensation is $15 to $45 USD per hour for contractor work.

• Pay type: hourly
• Currency: USD
• Hourly range: $15 to $45
• Employment types: contractor and part-time
• Worldwide availability excludes the locations listed above