Skip to content
← Back to explorer

Benchmark Hub

MATH Benchmark Papers (Last 60 Days)

Updated from current HFEPX corpus (Feb 27, 2026). 13 papers are grouped in this benchmark page. Common evaluation modes: Automatic Metrics, Simulation Env. Most common rater population: Domain Experts. Common annotation unit: Ranking. Frequently cited benchmark: MATH. Common metric signal: accuracy. Use this page to compare protocol setup, judge behavior, and labeling design decisions before running new eval experiments. Newest paper in this set is from Feb 24, 2026.

Papers: 13 Last published: Feb 24, 2026 Global RSS

Research Narrative

Grounded narrative Model: deterministic-grounded Source: persisted

Updated from current HFEPX corpus (Feb 27, 2026). This page tracks 13 papers for MATH Benchmark Papers (Last 60 Days). Dominant protocol signals include automatic metrics, simulation environments, with frequent benchmark focus on MATH, AIME and metric focus on accuracy, cost. Use the grounded sections below to prioritize reproducible protocol choices, benchmark-matched comparisons, and judge-vs-human evaluation checks.

Why This Matters For Eval Research

Protocol Takeaways

Benchmark Interpretation

  • MATH appears in 100% of hub papers (13/13); use this cohort for benchmark-matched comparisons.
  • AIME appears in 7.7% of hub papers (1/13); use this cohort for benchmark-matched comparisons.

Metric Interpretation

  • accuracy is reported in 61.5% of hub papers (8/13); compare with a secondary metric before ranking methods.
  • cost is reported in 7.7% of hub papers (1/13); compare with a secondary metric before ranking methods.

Researcher Checklist

  • Close gap on Papers with explicit human feedback. Coverage is a replication risk (7.7% vs 45% target).
  • Close gap on Papers reporting quality controls. Coverage is a replication risk (0% vs 30% target).
  • Maintain strength on Papers naming benchmarks/datasets. Coverage is strong (100% vs 35% target).
  • Maintain strength on Papers naming evaluation metrics. Coverage is strong (76.9% vs 35% target).
  • Close gap on Papers with known rater population. Coverage is a replication risk (15.4% vs 35% target).
  • Close gap on Papers with known annotation unit. Coverage is a replication risk (15.4% vs 35% target).

Papers with explicit human feedback

Coverage is a replication risk (7.7% vs 45% target).

Papers reporting quality controls

Coverage is a replication risk (0% vs 30% target).

Papers naming benchmarks/datasets

Coverage is strong (100% vs 35% target).

Papers naming evaluation metrics

Coverage is strong (76.9% vs 35% target).

Papers with known rater population

Coverage is a replication risk (15.4% vs 35% target).

Papers with known annotation unit

Coverage is a replication risk (15.4% vs 35% target).

Suggested Reading Order

  1. 1. Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning

    Start here for detailed protocol reporting, including rater and quality-control evidence.

  2. 2. Gradient Regularization Prevents Reward Hacking in Reinforcement Learning from Human Feedback and Verifiable Rewards

    Start here for detailed protocol reporting, including rater and quality-control evidence.

  3. 3. RFEval: Benchmarking Reasoning Faithfulness under Counterfactual Reasoning Intervention in Large Reasoning Models

    Start here for detailed protocol reporting, including rater and quality-control evidence.

  4. 4. Utility-Preserving De-Identification for Math Tutoring: Investigating Numeric Ambiguity in the MathEd-PII Benchmark Dataset

    Adds automatic metrics for broader coverage within this hub.

  5. 5. From Growing to Looping: A Unified View of Iterative Computation in LLMs

    Adds automatic metrics for broader coverage within this hub.

  6. 6. Learning to Learn from Language Feedback with Social Meta-Learning

    Adds automatic metrics for broader coverage within this hub.

  7. 7. Recursive Concept Evolution for Compositional Reasoning in Large Language Models

    Adds automatic metrics for broader coverage within this hub.

  8. 8. Prescriptive Scaling Reveals the Evolution of Language Model Capabilities

    Adds automatic metrics for broader coverage within this hub.

Known Limitations

  • Only 0% of papers report quality controls; prioritize calibration/adjudication evidence.
  • Rater population is under-specified (15.4% coverage).
  • Narrative synthesis is grounded in metadata and abstracts only; full-paper implementation details are not parsed.

Research Utility Links

automatic_metrics vs simulation_env

both=0, left_only=12, right_only=1

0 papers use both Automatic Metrics and Simulation Env.

Benchmark Brief

AIME

Coverage: 1 papers (7.7%)

1 papers (7.7%) mention AIME.

Examples: Overconfident Errors Need Stronger Correction: Asymmetric Confidence Penalties for Reinforcement Learning

Benchmark Brief

ARC

Coverage: 1 papers (7.7%)

1 papers (7.7%) mention ARC.

Examples: Recursive Concept Evolution for Compositional Reasoning in Large Language Models

Metric Brief

cost

Coverage: 1 papers (7.7%)

1 papers (7.7%) mention cost.

Examples: Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters

Metric Brief

f1

Coverage: 1 papers (7.7%)

1 papers (7.7%) mention f1.

Examples: Utility-Preserving De-Identification for Math Tutoring: Investigating Numeric Ambiguity in the MathEd-PII Benchmark Dataset

Top Papers On This Benchmark

Other Benchmark Hubs