OpenTrain AI
No verified implementation yet

p-less Sampling: A Robust Hyperparameter-Free Approach for LLM Decoding

Runyan Tan, Shuang Wu, Phillip Howard

September 27, 2025arXiv: 2509.23234
1 repo~a few days to reproduce
arXiv PDF

Abstract

Obtaining high-quality outputs from Large Language Models (LLMs) often depends upon the choice of a sampling-based decoding strategy to probabilistically choose the next token at each generation step. While a variety of such sampling methods have been proposed, their performance can be sensitive to the selection of hyperparameters which may require different settings depending upon the generation task and temperature...

Results & Benchmarks

TaskDatasetMetricValue
Reasoning / puzzle solvingGPQAAUC0.5
Reasoning / puzzle solvingGSM8KAUC0.7

Hardware Requirements

  • Expect multi-day setup/compute for meaningful reproduction based on current guidance.

Best Implementation

Maintained implementation evidence is not confirmed for this paper yet.

Use the Implementation Status and Reproduction Path sections below for the current action plan.

Reproduction Path

Follow this baseline workflow to decide if this paper is worth immediate prototyping.

  1. 1

    Use the paper and benchmark evidence to scope a baseline reproduction plan.

  2. 2

    Track assumptions and missing details in an experiment log before coding.

Time to first repro: a few daysEstimate is based on paper-only reproduction flow

Additional Implementations

Official

No additional official repositories detected.

Community

  • ryttry/p-lessConfidence: low

    Code for the Paper "p-less Sampling: A Robust Hyperparameter-Free Approach for LLM Decoding" (https://arxiv.org/abs/2509.23234).

    Stars: 8Forks: 1Last push: Oct 2025License: MIT

Hugging Face Artifacts

No trustworthy direct or curated related Hugging Face artifacts were found yet.