What Scales in Cross-Entropy Scaling Law?
Junxi Yan, Zixi Wei, Qingyao Ai, Yiqun Liu, Jingtao Zhan · Oct 5, 2025
Citations: 0
Platform Overview
Hire, manage, and pay top AI Trainers & Data Labelers in one place while working in the tools you already use
Find Data Labeling Vendors
Browse vetted agencies and BPOs for large-scale projects.
List your data labeling company
Create a free company profile, receive matched RFPs, and submit proposals with your pricing, capacity, and timeline.
JOIN AS Freelancer
The #1 Platform for Finding AI Training Jobs
We bring AI training and data labeling jobs from 20+ platforms into one place.
Work With Us
Hire Freelancers
Post a Job to the #1 Network for AI Training Talent Now
Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.
FOR LARGE PROJECTS / MANAGED SERVICE
Done-for-You AI Data Teams
For large or complex projects. We recruit, train, manage, and QA your team inside your tools.
JOIN AS Freelancer
The #1 Platform for Finding AI Training Jobs
We bring AI training and data labeling jobs from 20+ platforms into one place.
LLM & Agents
View All LLM & Agent Solutions
Structured Data Labeling
View Data Labeling Solutions
Work With Us
Hire Freelancers
Post a Job to the #1 Network for AI Training Talent Now
Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.
FOR LARGE PROJECTS / MANAGED SERVICE
Done-for-You AI Data Teams
For large or complex projects. We recruit, train, manage, and QA your team inside your tools.
Work With Us
Hire Freelancers
Post a Job to the #1 Network for AI Training Talent Now
Post your job and find pre-vetted AI Trainers & Data Labelers across any domain, language, or tool.
FOR LARGE PROJECTS / MANAGED SERVICE
Done-for-You AI Data Teams
For large or complex projects. We recruit, train, manage, and QA your team inside your tools.
Researcher Tools
Paper Explorer (HFEPX)
Browse high-signal papers for RLHF, human feedback datasets, and LLM/agent evaluation workflows.
Paper2Code Finder
Find the best implementation and artifacts for any paper by arXiv ID, DOI, URL, or title.
AI & ML Glossary
Browse 500+ AI and machine learning terms with definitions, examples, and explanations.
Researcher Tools
Human Feedback and Eval Paper Explorer
A focused feed for RLHF, preference data, rater protocols, agent evaluation, and LLM-as-judge research. Every paper includes structured metadata for quick triage.
Filter by tag
LiLo-VLA: Compositional Long-Horizon Manipulation via Linked Object-Centric Policies
Yue Yang, Shuo Cheng, Yu Fang, Homanga Bharadhwaj, Mingyu Ding, Gedas Bertasius · Feb 25, 2026
Citations: 0
Simulation Env Long Horizon General
- We introduce a 21-task simulation benchmark consisting of two challenging suites: LIBERO-Long++ and Ultra-Long.
- Furthermore, real-world evaluations across 8 long-horizon tasks demonstrate an average success rate of 85%.
PoSh: Using Scene Graphs To Guide LLMs-as-a-Judge For Detailed Image Descriptions
Amith Ananthram, Elias Stengel-Eskin, Lorena A. Bradford, Julia Demarest, Adam Purvis, Keith Krut · Oct 21, 2025
Citations: 0
Rubric Rating Human EvalLlm As Judge General
- In this work, we introduce PoSh, a metric for detailed image description that uses scene graphs as structured rubrics to guide LLMs-as-a-Judge, producing aggregate scores grounded in fine-grained errors (e.g.
- We show that PoSh achieves stronger correlations (+0.05 Spearman ρ) with the human judgments in DOCENT than the best open-weight alternatives, is robust to image type (using CapArena, an existing dataset of web imagery) and is a capable…
Polynomial Mixing for Efficient Self-supervised Speech Encoders
Eva Feillet, Ryan Whetten, David Picard, Alexandre Allauzen · Feb 28, 2026
Citations: 0
BankMathBench: A Benchmark for Numerical Reasoning in Banking Scenarios
Yunseung Lee, Subin Kim, Youngjun Kwak, Jaegul Choo · Feb 19, 2026
Citations: 0
Automatic Metrics Long Horizon Math
- However, such errors have rarely been captured by existing benchmarks.
- Mathematical datasets focus on fundamental math problems, whereas financial benchmarks primarily target financial documents, leaving everyday banking scenarios underexplored.
Whisper: Courtside Edition Enhancing ASR Performance Through LLM-Driven Context Generation
Yonathan Ron, Shiri Gilboa, Tammuz Dubnov · Feb 21, 2026
Citations: 0
Automatic Metrics Multi Agent Law
- We introduce Whisper: Courtside Edition, a novel multi-agent large language model (LLM) pipeline that enhances Whisper transcriptions without retraining.
- The pipeline intercepts Whisper's initial transcript, applies specialized LLM agents for domain context identification, named entity recognition, and jargon detection, and generates compact prompts that guide Whisper's decoder.
MALLVI: A Multi-Agent Framework for Integrated Generalized Robotics Manipulation
Iman Ahmadi, Mehrshad Taji, Arad Mahdinezhad Kashani, AmirHossein Jadidi, Saina Kashani, Babak Khalaj · Feb 18, 2026
Citations: 0
Simulation Env Multi Agent Coding
- MALLVI presents a Multi Agent Large Language and Vision framework that enables closed-loop feedback driven robotic manipulation.
- Rather than using a single model, MALLVI coordinates specialized agents, Decomposer, Localizer, Thinker, and Reflector, to manage perception, localization, reasoning, and high level planning.
How Many Code and Test Cases Are Enough? Evaluating Test Cases Generation from a Binary-Matrix Perspective
Xianzhen Luo, Jinyang Huang, Wenzhen Zheng, Qingfu Zhu, Mingzheng Xu, Yiheng Xu · Oct 9, 2025
Citations: 0
SCOPE: Selective Conformal Optimized Pairwise LLM Judging
Sher Badshah, Ali Emami, Hassan Sajjad · Feb 13, 2026
Citations: 0
Pairwise Preference Automatic Metrics General
- Large language models (LLMs) are increasingly used as judges to replace costly human preference labels in pairwise evaluation.
- To provide SCOPE with a bias-neutral uncertainty signal, we introduce Bidirectional Preference Entropy (BPE), which queries the judge under both response positions, aggregates the implied preference probabilities to enforce invariance to…
A cross-species neural foundation model for end-to-end speech decoding
Yizi Zhang, Linyang He, Chaofei Fan, Tingkai Liu, Han Yu, Trung Le · Nov 21, 2025
Citations: 0
Protocol Hubs
Expert Verification Papers (32)
CS.CL + Expert Verification Papers (24)
Pairwise Preference Papers (89)
CS.CL + Pairwise Preference Papers (74)
Coding Papers (69)
CS.CL Human Feedback And Eval Papers (1,020)
CS.AI + Expert Verification Papers (20)
CS.AI Human Feedback And Eval Papers (794)
Expert Verification Or Pairwise Preference Papers (118)
Pairwise Preference Papers (Last 120 Days) (59)
Pairwise Preference Papers (Last 90 Days) (58)
Pairwise Preference Papers (Last 60 Days) (57)
Long Horizon Papers (101)
CS.AI + Pairwise Preference Papers (52)
Expert Verification Or Rubric Rating Papers (50)
CS.CL + Coding Papers (51)
Benchmark Hubs
Metric Hubs
- Accuracy & Pass Rate Metric Papers (88)
- Accuracy Metric Papers (82)
- Accuracy & Pass Rate Metric Papers In CS.CL (63)
- Accuracy & Pass Rate Metric Papers + Automatic Metrics (74)
- Accuracy In CS.CL Papers (58)
- Accuracy & Pass Rate Metric Papers In CS.AI (58)
- Accuracy + Automatic Metrics Metric Papers (70)
- Accuracy + Automatic Metrics Metric Papers (Last 120 Days) (53)
- Accuracy + Automatic Metrics Metric Papers (Last 90 Days) (51)
- Accuracy + Automatic Metrics Metric Papers (Last 30 Days) (47)
Need human evaluators for your AI research? Scale annotation with expert AI Trainers.