Skip to content
OpenTrain AIFor AI Companies

WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

Liyan Tang, Cyrus Rashtchian, Chun-Sung Ferng, Andrew Tomkins, Da-Cheng Juan +1 morePublished Aug 27, 2026
arXiv PDF
Researcher verdict
Starting point
Use as implementation starting point
Benchmark evidence
Thin evidence
Verify before relying
Time to first repro
A few hours
Fast first run
Risk flags
0
None detected

Abstract

Domain fit: AI-adjacent · Paper appears method- or tooling-adjacent to AI workflows with partial ecosystem coverage.

Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.

Results and benchmarks

Freshness tier: hot
Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities.
Task Dataset Metric Value Source
Agentic tool use Qwen-3.5-4B LiveMath 29.1 paper-derived
Agentic tool use Trace2Skill LiveMath 37.6 paper-derived

Audit each benchmark finding before selecting an implementation path. Evidence refs map to the disclosure below.

Implementation

Best maintained implementation now

Recommended
Confidence: Medium
Reproducibility: Strong

WikiSkill (arXiv:2608.27454) for Hermes Agent — self-evolving agent skills via a persistent knowledge wiki. Faithful Algorithm 1 implementation with real agent runs, isolated skill gating, and a documented live run log.

264 stars · 26 forks · Last push Sep 15, 2026 · MIT license

  • License
  • CI
  • Dependencies
  • Docker

Matched via arXiv identifier search · Strong overlap with paper title keywords · Community adoption signal (264 stars)

Why this implementation
Confidence: medium

ashutoshsinghpr7/wikiskill is the best available implementation candidate based on ranking signals, but recommendation confidence is not yet high. CI workflows are present. License is declared (MIT).

Open ashutoshsinghpr7/wikiskill
Reproduction risks
  • No repository-level red flags were detected, but paper-specific preprocessing and hyperparameter details may still be under-specified.
  • Selected ashutoshsinghpr7/wikiskill as the strongest maintained implementation for new work.
  • Includes CI workflow signals.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.

Compare implementation paths

Compare maintenance quality, reproducibility coverage, and evidence confidence before choosing a reproduction baseline.

Maintenance
Active
Confidence
Medium
Reproducibility
Strong
Stars
264
Last push
Sep 15, 2026 (21d)

Matched via arXiv identifier search · Strong overlap with paper title keywords

  • No Docker setup
Maintenance
Active
Confidence
Medium
Reproducibility
Moderate
Stars
1,333
Last push
Oct 5, 2026 (1d)

Matched via arXiv identifier search · Partial overlap with paper title keywords

  • No Docker setup
  • Dependency manifest missing
Maintenance
Active
Confidence
Medium
Reproducibility
Moderate
Stars
436
Last push
Oct 4, 2026 (2d)

Matched via arXiv identifier search · Partial overlap with paper title keywords

  • No Docker setup
  • Dependency manifest missing

Reproduction readiness

Time to first repro: hours
Last checked: Oct 5, 2026

Ready to run

Ready to reproduce

  • Clone ashutoshsinghpr7/wikiskill and install dependencies from pyproject.toml.
  • CI pipeline detected, so automated tests are in place.
  • Last updated 21 days ago.
Open ashutoshsinghpr7/wikiskill

Quick start

git clone https://github.com/ashutoshsinghpr7/wikiskill.git
pip install -e .

Repositories and ecosystem

Official

No additional official repositories detected.

Community

  • first-fluke/oh-my-agent
    Confidence: Medium

    Mechanical verification for AI coding agents — skills pack or full harness (stop-hook gates, artifact checks, independent judges).

    1,333 stars · 149 forks · Last push Oct 5, 2026 · MIT license

  • sno-ai/sno-station
    Confidence: Medium

    Sno Station — your Claude Code and Codex working as one squad on your own machine. Shared encrypted memory, agent-to-agent messaging (Reach), squad skills for handoff and cross-vendor review, and a nightly loop that rewrites the agents' own skills with your approval. Open source, no daemon, no cloud required. Assembled in public.

    436 stars · 349 forks · Last push Oct 4, 2026 · Apache-2.0 license

  • Stahl-G/wikiskill
    Confidence: Medium

    A self-evolving skill framework for evaluable agent tasks, with reproducible multi-domain validation experiments.

    45 stars · 4 forks · Last push Sep 29, 2026 · MIT license

Hugging Face artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts for faster exploration.

Models

No trustworthy models matches right now.

Search models on Hugging Face

Datasets

Curated Related

Spaces

No trustworthy spaces matches right now.

Search spaces on Hugging Face

Research context

Tasks

Agentic tool use

Methods

Agentic systems

Domains

AI Agents

Evaluation and human feedback data

Open this paper in HFEPX to review benchmark signals, evaluation modes, and human-feedback protocol context.

Open in HFEPX
Explore similar papers

Jump to Paper2Code search queries derived from this paper's research context.