Depth-Breadth Synergy in RLVR: Unlocking LLM Reasoning Gains with Adaptive Exploration
Zhicheng Yang, Zhijiang Guo, Yinya Huang, Yongxin Wang, Dongchun Xie +4 more
Abstract
Reinforcement Learning with Verifiable Reward (RLVR) has emerged as a powerful paradigm for unlocking reasoning capabilities in large language models, yet its full potential is hindered by two under-explored dimensions: Depth-the hardest problem a model can sample; Breadth-the number of instances consumed in a single iteration. We dissect the popular GRPO algorithm and reveal a systematic bias: the cumulative-advanta...
Results & Benchmarks
| Task | Dataset | Metric | Value |
|---|---|---|---|
| Reinforcement learning | MATH | pass@1 | 80.8 |
| Reinforcement learning | GPQA | pass@64 | 64 |
| Reinforcement learning | HumanEval | pass@64 | 85.8 |
| Reinforcement learning | MATH(Avg@128) | pass@128 | 50.1 |
Hardware Requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Best Implementation
Maintained implementation evidence is not confirmed for this paper yet.
Use the Implementation Status and Reproduction Path sections below for the current action plan.
Reproduction Path
Follow this baseline workflow to decide if this paper is worth immediate prototyping.
- 1
Use the paper and benchmark evidence to scope a baseline reproduction plan.
- 2
Start from this likely method family: Reinforcement learning.
- 3
Track assumptions and missing details in an experiment log before coding.
Additional Implementations
Official
No additional official repositories detected.
Community
- yangzhch6/DARSConfidence: low
The official implemention of "Depth-Breadth Synergy in RLVR: Unlocking LLM Reasoning Gains with Adaptive Exploration"
Stars: 24Forks: 0Last push: Feb 2026License: MIT
Hugging Face Artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet.
Continue with targeted Hugging Face searches: