Results and benchmarks
Programming Puzzles focuses on reasoning / puzzle solving.
Benchmark evidence is limited
Evidence graph: 3 refs, 3 links.
Utility signals: depth 45/100, grounding 75/100, status medium.
Implementation
Historical official implementation (not recommended for new builds)
Only a historical official implementation is available
Use with caution for new projects; verify against current tooling and maintained community alternatives.
microsoft/PythonProgrammingPuzzles · 997 stars · Last push Apr 24, 2024 · Archived
suzgunmirac/meta-prompting is the closest maintained adjacent implementation (Matched via arXiv identifier search). It is not paper-verified; validate algorithm and evaluation setup against the paper before trusting reported metrics. Community adoption signal: 420 GitHub stars.
Open microsoft/PythonProgrammingPuzzles- Adjacent implementations are not paper-verified
- Recommended repository is adjacent and not paper-verified.
- Adjacent implementation match confidence is low.
- No direct maintained implementation is currently verified.
- Only historical official repository was found: microsoft/PythonProgrammingPuzzles.
- No maintained paper-verified implementation met reliability thresholds.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Archived
- Confidence
- High
- Reproducibility
- Limited
- Stars
- 997
- Last push
- Apr 24, 2024 (854d)
Official implementation from Papers with Code · Repository link is mentioned in the paper metadata
- Repository archived
- No push in 12+ months
- No Docker setup
- Maintenance
- Recently updated
- Confidence
- Low
- Reproducibility
- Moderate
- Stars
- 2
- Last push
- Jun 15, 2026 (71d)
Matched via arXiv identifier search
- No Docker setup
- Low confidence match
- Maintenance
- Stale
- Confidence
- Low
- Reproducibility
- Moderate
- Stars
- 0
- Last push
- Nov 13, 2024 (650d)
Matched via arXiv identifier search
- No push in 12+ months
- No CI pipeline detected
- No tagged releases
Reproduction readiness
Major work
Repository archived, fork required
- microsoft/PythonProgrammingPuzzles has been archived. Fork the repository before using it.
- No further updates or bug fixes will be made by the original authors.
Hardware requirements
- Expect multi-day setup/compute for meaningful reproduction based on current guidance.
Validation caveat
Repositories and ecosystem
Closest related implementations
These are not paper-verified. Use them as reference points when no direct implementation is available.
- suzgunmirac/meta-prompting Adjacent · Confidence: Low · 420 stars
Matched via arXiv identifier search
- google-research/babelcode Adjacent · Confidence: Low · 56 stars
Matched via arXiv identifier search
No additional verified repositories beyond the primary recommendation.
These repositories had low-confidence matching signals and are hidden by default.
- hon9kon9ize/infinite-rl
Confidence: Low · 2 stars
- grao5/meta-prompting-main
Confidence: Low · 0 stars
Hugging Face artifacts
No trustworthy direct or curated related Hugging Face artifacts were found yet. Use targeted searches to quickly locate candidate models, datasets, and demos.
Tip: start with models, then check datasets and spaces if you need evaluation data or demos.
Research context
Tasks
Reasoning / puzzle solving
Methods
None detected
Domains
None detected
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.
Data includes links from Papers with Code ( CC-BY-SA-4.0 ).