WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
Abstract
Domain fit: AI-adjacent · Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.
Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.
Results and benchmarks
Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities.
| Task | Dataset | Metric | Value | Source |
|---|---|---|---|---|
| Agentic tool use | Qwen-3.5-4B | LiveMath | 29.1 | paper-derived |
| Agentic tool use | Trace2Skill | LiveMath | 37.6 | paper-derived |
Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.
Evidence graph: 3 refs, 3 links.
Utility signals: depth 90/100, grounding 85/100, status high.
Implementation
Best maintained implementation now
WikiSkill (arXiv:2608.27454) for Hermes Agent — self-evolving agent skills via a persistent knowledge wiki. Faithful Algorithm 1 implementation with real agent runs, isolated skill gating, and a documented live run log.
264 stars · 26 forks · Last push Sep 15, 2026 · MIT license
- License
- CI
- Dependencies
- Docker
Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (264 stars)
ashutoshsinghpr7/wikiskill is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (MIT).
Open ashutoshsinghpr7/wikiskill- No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
- Selected ashutoshsinghpr7/wikiskill as the strongest maintained implementation for new work.
- Includes CI workflow signals.
- Includes dependency/environment manifest signals.
- Repository activity is within the last 24 months.
Compare implementation paths
Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.
- Maintenance
- Active
- Confidence
- Medium
- Reproducibility
- Strong
- Stars
- 264
- Last push
- Sep 15, 2026 (21d)
Matched via arXiv identifier search · Strong overlap with paper title keywords
- No Docker setup
- Maintenance
- Active
- Confidence
- Medium
- Reproducibility
- Moderate
- Stars
- 1,333
- Last push
- Oct 5, 2026 (1d)
Matched via arXiv identifier search · Partial overlap with paper title keywords
- No Docker setup
- Dependency manifest missing
- Maintenance
- Active
- Confidence
- Medium
- Reproducibility
- Moderate
- Stars
- 436
- Last push
- Oct 4, 2026 (2d)
Matched via arXiv identifier search · Partial overlap with paper title keywords
- No Docker setup
- Dependency manifest missing
Reproduction readiness
Ready to run
Ready to reproduce
- Clone ashutoshsinghpr7/wikiskill and install dependencies from pyproject.toml.
- CI pipeline detected, so automated tests are in place.
- Last updated 21 days ago.
Quick start
git clone https://github.com/ashutoshsinghpr7/wikiskill.git
pip install -e . Repositories and ecosystem
Official
No additional official repositories detected.
Community
- first-fluke/oh-my-agentConfidence: Medium
Mechanical verification for AI coding agents — skills pack or full harness (stop-hook gates, artifact checks, independent judges).
1,333 stars · 149 forks · Last push Oct 5, 2026 · MIT license
- sno-ai/sno-stationConfidence: Medium
Sno Station — your Claude Code and Codex working as one squad on your own machine. Shared encrypted memory, agent-to-agent messaging (Reach), squad skills for handoff and cross-vendor review, and a nightly loop that rewrites the agents' own skills with your approval. Open source, no daemon, no cloud required. Assembled in public.
436 stars · 349 forks · Last push Oct 4, 2026 · Apache-2.0 license
- Stahl-G/wikiskillConfidence: Medium
A self-evolving skill framework for evaluable agent tasks, with reproducible multi-domain validation experiments.
45 stars · 4 forks · Last push Sep 29, 2026 · MIT license
These repositories had low-confidence matching signals and are hidden by default.
- HangYu8123/HarnessFlow
Confidence: Low · 462 stars
- GodModeAI2025/skill-forge
Confidence: Low · 18 stars
- HangYu8123/mini-harness
Confidence: Low · 196 stars
- martjay/Wiki-Skill
Confidence: Low · 9 stars
Hugging Face artifacts
No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.
Models
No trustworthy models matches right now.
Search models on Hugging FaceDatasets
- osunlp/early-experience
377 downloads · 9 likes · Updated Jul 7, 2026
- tekloon/agent-experience-level
30 downloads · 0 likes · Updated Jul 21, 2024
Broaden dataset search
Spaces
No trustworthy spaces matches right now.
Search spaces on Hugging FaceResearch context
Tasks
Agentic tool use
Methods
Agentic systems
Domains
AI Agents
Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.
Open in HFEPXJump to Paper2Code search queries derived from this paper's research context.