Pricing Managed Service For Large Projects

Platform Overview

Hire, manage, and pay top AI Trainers & Data Labelers in one place while working in the tools you already use

How It Works

Learn how we make hiring and managing AI Trainers simple.

Data Labeling Tool Integrations

Hire experts for any labeling tool, including your custom platform.

Pricing

Get transparent pricing and start hiring with scalable costs.

Solutions

Find specialists for any LLM and labeling workflow you can imagine.

Find Data Labeling Vendors

Browse vetted agencies and BPOs for large-scale projects.

List your data labeling company

Create a free company profile, receive matched RFPs, and submit proposals with your pricing, capacity, and timeline.

JOIN AS Freelancer

The #1 Platform for Finding AI Training Jobs

We bring AI training and data labeling jobs from 20+ platforms into one place.

Work With Us

Hire Freelancers

Post a Job to the #1 Network for AI Training Talent Now

Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.

FOR LARGE PROJECTS / MANAGED SERVICE

Done-for-You AI Data Teams

For large or complex projects. We recruit, train, manage, and QA your team inside your tools.

JOIN AS Freelancer

The #1 Platform for Finding AI Training Jobs

We bring AI training and data labeling jobs from 20+ platforms into one place.

LLM & Agents

LLM Evaluation

Red Teaming

Hallucination Audits

RLHF & Preference Data

Supervised Fine-Tuning

Code Generation Review

Function Calling

View All LLM & Agent Solutions

Structured Data Labeling

Speech and Audio Labeling

Time Series Annotation

View Data Labeling Solutions

Work With Us

Hire Freelancers

Post a Job to the #1 Network for AI Training Talent Now

Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.

FOR LARGE PROJECTS / MANAGED SERVICE

Done-for-You AI Data Teams

For large or complex projects. We recruit, train, manage, and QA your team inside your tools.

Work With Us

Hire Freelancers

Post a Job to the #1 Network for AI Training Talent Now

Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.

FOR LARGE PROJECTS / MANAGED SERVICE

Done-for-You AI Data Teams

For large or complex projects. We recruit, train, manage, and QA your team inside your tools.

Multimodal

Vision

Text

Bring Your Own Platform

We're the talent layer, not the tool. Hire AI Trainers and Data Labelers into any platform - commercial, open-source, or your own internal tooling.

Researcher Tools

Paper Explorer (HFEPX)

Browse high-signal papers for RLHF, human feedback datasets, and LLM/agent evaluation workflows.

Paper2Code Finder

Find the best implementation and artifacts for any paper by arXiv ID, DOI, URL, or title.

AI & ML Glossary

Browse 500+ AI and machine learning terms with definitions, examples, and explanations.

Platform Overview

Hire, manage, and pay top AI Trainers & Data Labelers in one place while working in the tools you already use

How It Works

Learn how we make hiring and managing AI Trainers simple.

Data Labeling Tool Integrations

Hire experts for any labeling tool, including your custom platform.

Pricing

Get transparent pricing and start hiring with scalable costs.

Solutions

Find specialists for any LLM and labeling workflow you can imagine.

Find Data Labeling Vendors

Browse vetted agencies and BPOs for large-scale projects.

List your data labeling company

Create a free company profile, receive matched RFPs, and submit proposals with your pricing, capacity, and timeline.

JOIN AS Freelancer

The #1 Platform for Finding AI Training Jobs

We bring AI training and data labeling jobs from 20+ platforms into one place.

Work With Us

Hire Freelancers

Post a Job to the #1 Network for AI Training Talent Now

Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.

FOR LARGE PROJECTS / MANAGED SERVICE

Done-for-You AI Data Teams

For large or complex projects. We recruit, train, manage, and QA your team inside your tools.

JOIN AS Freelancer

The #1 Platform for Finding AI Training Jobs

We bring AI training and data labeling jobs from 20+ platforms into one place.

LLM & Agents

LLM Evaluation

Red Teaming

Hallucination Audits

RLHF & Preference Data

Supervised Fine-Tuning

Code Generation Review

Function Calling

View All LLM & Agent Solutions

Structured Data Labeling

Speech and Audio Labeling

Time Series Annotation

View Data Labeling Solutions

Work With Us

Hire Freelancers

Post a Job to the #1 Network for AI Training Talent Now

Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.

FOR LARGE PROJECTS / MANAGED SERVICE

Done-for-You AI Data Teams

For large or complex projects. We recruit, train, manage, and QA your team inside your tools.

Work With Us

Hire Freelancers

Post a Job to the #1 Network for AI Training Talent Now

Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.

FOR LARGE PROJECTS / MANAGED SERVICE

Done-for-You AI Data Teams

For large or complex projects. We recruit, train, manage, and QA your team inside your tools.

Multimodal

Vision

Text

Bring Your Own Platform

We're the talent layer, not the tool. Hire AI Trainers and Data Labelers into any platform - commercial, open-source, or your own internal tooling.

Invite AI Trainers and Data Labelers into your custom tool

Researcher Tools

Paper Explorer (HFEPX)

Browse high-signal papers for RLHF, human feedback datasets, and LLM/agent evaluation workflows.

Paper2Code Finder

Find the best implementation and artifacts for any paper by arXiv ID, DOI, URL, or title.

AI & ML Glossary

Browse 500+ AI and machine learning terms with definitions, examples, and explanations.

Pricing Managed Service For Large Projects

Researcher Tools

Human Feedback and Eval Paper Explorer

A focused feed for RLHF, preference data, rater protocols, agent evaluation, and LLM-as-judge research. Every paper includes structured metadata for quick triage.

Total papers: 1 Search mode: keyword RSS

Filter by tag

All Automatic Metrics (527) General (186) Long Horizon (106) Pairwise Preference (91) Coding (69) Simulation Env (67) Multi Agent (46) Medicine (35) Expert Verification (33) Llm As Judge (28) Human Eval (25) Web Browsing (25) Rubric Rating (24) Red Team (23) Critique Edit (22) Multilingual (21)

MemoryArena: Benchmarking Agent Memory in Interdependent Multi-Session Agentic Tasks

Zexue He, Yu Wang, Churan Zhi, Yuanzhe Hu, Tzu-Ping Chen, Lang Yin · Feb 18, 2026

Citations: 0

Pairwise Preference Automatic Metrics Web Browsing General

Existing evaluations of agents with memory typically assess memorization and action in isolation.
To capture this setting, we introduce MemoryArena, a unified evaluation gym for benchmarking agent memory in multi-session Memory-Agent-Environment loops.