Researcher Tools

Human Feedback and Eval Paper Explorer

A focused feed for RLHF, preference data, rater protocols, agent evaluation, and LLM-as-judge research. Every paper includes structured metadata for quick triage.

Total papers: 1 Search mode: hybrid Ranking: eval-signal prioritized Shortlist (0) RSS

Filter by tag

All Automatic Metrics (620) General (224) Long Horizon (124) Pairwise Preference (112) Coding (91) Simulation Env (83) Multi Agent (58) Medicine (40) Expert Verification (39) Llm As Judge (36) Web Browsing (32) Demonstrations (29) Human Eval (29) Red Team (29) Rubric Rating (29) Math (28)

Browse by Topic

Jump directly into tag and hub pages to crawl deeper content clusters.

Top Protocol Hubs

Start Here By Objective

Pick your immediate research objective and jump directly to high-signal pages, not generic search.

Benchmark Selection

Find papers with explicit benchmark anchors and comparable metric reporting.

Rater Protocol Design

Compare pairwise, rubric, and expert-verification setups before drafting your protocol.

LLM-as-Judge Setup

Start with established judge pipelines and then compare with human-eval references.

VULCA-Bench: A Multicultural Vision-Language Benchmark for Evaluating Cultural Understanding

Haorui Yu, Diji Yang, Hang He, Fengrui Zhang, Qiufeng Yi · Jan 12, 2026

Citations: 0

Match reason: Keyword overlap 1/4 across title and protocol fields. Eval-signal density: moderate protocol signal.

Score: 50% Moderate protocol signal Freshness: Warm Status: Fallback

Critique Edit General

We introduce VULCA-Bench, a multicultural art-critique benchmark for evaluating Vision-Language Models' (VLMs) cultural understanding beyond surface-level visual perception.
Existing VLM benchmarks predominantly measure L1-L2 capabilities (object recognition, scene description, and factual question answering) while under-evaluate higher-order cultural interpretation.

Open paper