llm-wiki

Ochiq manbalardan

Claude Code, Codex CLI, Copilot, Cursor va Gemini seanslaringizdan olingan, LLM asosidagi bilimlar bazasi. Karpatiyning LLM Wiki patterni — amalga oshirilgan va taqdim etilgan.

Mashina tarjimasi · Asl matnni koʻrsatish

LLM-powered knowledge base from your Claude Code, Codex CLI, Copilot, Cursor & Gemini sessions. Karpathy's LLM Wiki pattern — implemented and shipped.

AI vositaKategoriya: AI vositalariOpen sourcemaʼlumot tekshirilgan: 16-okt, 2026

Sharh

  • ai
  • claude-code
  • cli
  • codex-cli
  • copilot
  • cursor
  • developer-tools
  • gemini-cli
  • karpathy
  • knowledge-base
  • llm
  • llm-wiki

Oʻrnatish

Buyruqlar faqat koʻrsatiladi, marketpleys ularni bajarmaydi. Rasmiy hujjatlar bilan solishtiring.
  • Rasmiy reliz fayllariOchiq manbalardanoxirgi rasmiy relizdan
    github.com/Pratiyush/llm-wiki/releases/tag/v1.3.82 ↗
  • Til paketlari reyestrinodejsOchiq manbalardanpaket manifestidan — reyestrda chop etilgani tekshirilmagan
    npm install -g llmwiki

    Tekshirilmagan: oʻrnatishdan oldin reyestrdagi paket aynan shu loyihaga tegishli ekanini tekshiring.

    www.npmjs.com/package/llmwiki ↗
  • Til paketlari reyestripythonOchiq manbalardanpaket manifestidan — reyestrda chop etilgani tekshirilmagan
    pipx install llm-notebook

    Tekshirilmagan: oʻrnatishdan oldin reyestrdagi paket aynan shu loyihaga tegishli ekanini tekshiring.

    pypi.org/project/llm-notebook/ ↗
  • Manbadan yigʻishOchiq manbalardankatalog metamaʼlumotlaridan

    Manbadan yigʻish: tekshirilgan yigʻish retsepti yoʻq — repozitoriy koʻrsatmalariga amal qiling.

    github.com/Pratiyush/llm-wiki ↗

Moslik

«Nomaʼlum» dalil topilmaganini bildiradi, mahsulot mos emasligini emas.
PlatformaHolatArxitekturaDalilIshonchlilik
WindowsNomaʼlum———
macOSNomaʼlum———
LinuxNomaʼlum———
Web browserNomaʼlum———
Server / self-hostedNomaʼlum———
Container (OCI)Nomaʼlum———
Node.jsMos—paket manifesti: package.json name0.60
PythonMos—v1.3.82 relizidagi rasmiy yigʻma: llm_notebook-1.3.82-py3-none-any.whl0.60

Relizlar

tekshirilgan: 30-okt, 2026
v1.3.82Oxirgi30-apr, 2026Rasmiy manba ↗

1.3.82 versiyasi fayllari

Marketpleys bu fayllarni saqlamaydi: yuklab olish rasmiy manbadan. Biz ularni skanerlamaganmiz.
FaylPlatformaHajmSHA-256Rasmiy manbadan yuklab olish
llm_notebook-1.3.82-py3-none-any.whlpython · wheel319,9 KBf49fc84d9ffe…Rasmiy manba ↗
llm_notebook-1.3.82.tar.gzNomaʼlum547 KB352933fdaf42…Rasmiy manba ↗
llm_notebook-1.3.82-py3-none-any.whl.sigstore.jsonimzo10,3 KBb3e0cdd78376…Rasmiy manba ↗
llm_notebook-1.3.82.tar.gz.sigstore.jsonimzo10,4 KB82b9a2280064…Rasmiy manba ↗

Relizlar tarixi

Sifat profili

algoritm quality-v1.0 · baholangan 16-okt, 2026
Sifat bahosi83
Xavf bahosi0
Ishonchlilik 1.00
Sifat bahosi va xavf bahosi — turli koʻrsatkichlar. Yuqori sifat xavfsizlikni kafolatlamaydi.

Baho tarkibi

Qoʻllab-quvvatlash · 2012
last activity 119 days ago
Hujjatlar · 1515
README 37430 chars, description present
Foydalanishga tayyorlik · 1515
install instructions: yes; releases: yes
Metamaʼlumotlar · 108
3/4 of description, homepage, license, topics
Relizlar · 1010
10 release(s), latest 168 days ago
Kategoriya aniqligi · 107
classifier confidence 0.65
Ommaboplik · 107
397 stars (log-dampened, 10k = max)
Litsenziya aniqligi · 55
SPDX MIT
Hamjamiyat · 55
issues enabled, 55 forks

Litsenziya

MIT
Litsenziya maʼlumrepozitoriy xostingi maʼlumotlariga koʻra

Bu katalog siyosati holati, yuridik xulosa emas.

Manbalar

github.com/Pratiyush/llm-wikiAsosiy★ 397 yulduzfaollik: 18-iyn, 2026Asosiy repozitoriy · Ishonchlilik 1.00

Sharhlar

Sharh yozish uchun kiring

Hali sharhlar yoʻq.

Muqobillar

README

Pratiyush/llm-wiki dan · litsenziya MIT · yuklangan 30-okt, 2026

llmwiki

LLM-powered knowledge base from your Claude Code, Codex CLI, Cursor, Gemini CLI, and Obsidian sessions. Built on Andrej Karpathy's LLM Wiki pattern.

👉 Live demo: pratiyush.github.io/llm-wiki

Rebuilt on every master push from the synthetic sessions in examples/demo-sessions/. No personal data. Shows every feature of the real tool (activity heatmap, tool charts, token usage, model info cards, vs-comparisons, project topics) running against safe reference data.

[License: MIT] [Python 3.9+] [Version] [Tests] [CI] [Link check] [Wiki checks] [Docker] [Works with Claude Code] [Works with Codex CLI] [Works with Copilot] [Works with Cursor] [Works with Gemini CLI] [Works with Obsidian]


Every Claude Code, Codex CLI, Copilot, Cursor, and Gemini CLI session writes a full transcript to disk. You already have hundreds of them and never look at them again.

llmwiki turns that dormant history into a beautiful, searchable, interlinked knowledge base — locally, in two commands. Plus, it produces AI-consumable exports (llms.txt, llms-full.txt, JSON-LD graph, per-page .txt + .json siblings) so other AI agents can query your wiki directly.

./setup.sh                         # one-time install
./build.sh && ./serve.sh           # build + serve at http://127.0.0.1:8765

Want LLM-enriched wiki pages from the CLI? After ./setup.sh, llmwiki sync only fills raw/. To populate wiki/sources/ (semantic summaries), set synthesis.backend in examples/sessions_config.json (ollama for local Ollama, or keep dummy for stubs), then run llmwiki synthesize or chain it with llmwiki all --with-synth. See docs/modes/api/ and llmwiki sync --status for the current backend hint.

llmwiki sync
llmwiki all --with-synth --graph-engine builtin   # synthesize → build → graph → export → lint

[llmwiki — 70-second demo]

Contributing in one line: read CONTRIBUTING.md, keep PRs focused (one concern each), use feat: / fix: / docs: / chore: / test: commit prefixes, never commit real session data (raw/ is gitignored), no new runtime deps. CI must be green to merge.

Screenshots

All screenshots below are from the public demo site which is built on every master push from the dummy example sessions. Your own wiki will look identical — just with your real work.

Home — projects overview with activity heatmap

[llmwiki home page — LLM Wiki header, activity heatmap, and a grid of three demo projects (demo-blog-engine, demo-ml-pipeline, demo-todo-api)]

All sessions — filterable table across every project

[llmwiki sessions index — activity timeline above a table of eight demo sessions with project, model, date, message count, and tool-call columns]

Session detail — full conversation + tool calls

[llmwiki session detail — Rust blog engine scaffolding session showing summary, breadcrumbs, a TOML Cargo.toml block and a Rust main.rs block, both highlighted by highlight.js]

Changelog — renders CHANGELOG.md as a first-class page

[llmwiki changelog page — keep-a-changelog format with colored headings for Added / Fixed / Changed and auto-linked PR references]

Projects index — freshness badges + per-project stats

[llmwiki projects index — three demo project cards with green/yellow/red freshness badges showing how recently each project was touched]

What you get

Human-readable

  • All your sessions, converted from .jsonl to clean, redacted markdown
  • A Karpathy-style wiki — sources/, entities/, concepts/, syntheses/, comparisons/, questions/ linked with [[wikilinks]]
  • A beautiful static site you can browse locally or deploy to GitHub Pages
    • Global search (Cmd+K command palette with fuzzy match over pre-built index)
    • highlight.js client-side syntax highlighting (light + dark themes)
    • Dark mode (system-aware + manual toggle with data-theme)
    • Keyboard shortcuts: / search · g h/p/s nav · j/k rows · ? help
    • Collapsible tool-result sections (auto-expand > 500 chars)
    • Copy-as-markdown + copy-code buttons
    • Breadcrumbs + reading progress bar
    • Filter bar on sessions table (project/model/date/text)
    • Reading time estimates (X min read)
    • Related pages panel at the bottom of every session
    • Activity heatmap on the home page
    • Model info cards with structured schema (provider, pricing, benchmarks)
    • Auto-generated vs-comparison pages between AI models
    • Append-only changelog timeline with pricing sparkline
    • Project topic chips (GitHub-style tags on project cards)
    • Agent labels (colored badges: Claude/Codex/Copilot/Cursor/Gemini)
    • Recently-updated card on the home page
    • Dataview-style structured queries in the command palette
    • Hover-to-preview wikilinks
    • Deep-link icons next to every heading
    • Mobile-responsive + print-friendly

AI-consumable (v0.4)

Every HTML page has sibling machine-readable files at the same URL:

  • <page>.html — human HTML with schema.org microdata
  • <page>.txt — plain text version (no HTML tags)
  • <page>.json — structured metadata + body

Site-level AI-agent entry points:

FileWhat
/llms.txtShort index per llmstxt.org spec
/llms-full.txtFlattened plain-text dump (~5 MB cap) — paste into any LLM's context
/graph.jsonldSchema.org JSON-LD entity/concept/source graph
/sitemap.xmlStandard sitemap with lastmod
/rss.xmlRSS 2.0 feed of newest sessions
/robots.txtAI-friendly robots with llms.txt reference
/ai-readme.mdAI-specific navigation instructions
/manifest.jsonBuild manifest with SHA-256 hashes + perf budget

Every page also includes an <!-- llmwiki:metadata --> HTML comment that AI agents can parse without fetching the separate .json sibling.

Recipe — query graph.jsonld from your terminal

The JSON-LD graph isn't just for crawlers — you can ask quick questions about your wiki without leaving the shell. Example: print every session as a tree, grouped by project:

python3 examples/scripts/tree_from_graph.py

Output:

📚 8 sessions across 3 projects
   (site/graph.jsonld v1.3.0)

llmwiki/
├── demo-blog-engine/  (4 sessions)
│   ├── 2026-03-12  scaffolding-the-rust-blog-engine
│   ├── 2026-03-18  adding-syntax-highlighting
│   ├── 2026-03-25  rss-feed-and-sitemap
│   └── 2026-04-01  dark-mode-toggle
├── demo-ml-pipeline/  (2 sessions)
│   ├── 2026-01-20  training-data-pipeline
│   └── 2026-02-02  model-training-loop
└── demo-todo-api/  (2 sessions)
    ├── 2026-02-08  fastapi-project-bootstrap
    └── 2026-02-15  adding-oauth-login

The full script is stdlib-only at examples/scripts/tree_from_graph.py. Same recipe pattern works for any aggregation question — count sessions per model, find the largest project by token usage, list every entity that appears in 3+ sessions, etc. The graph is yours to slice.

Quality & governance (v1.0)

  • 4-factor confidence scoring — source count, source quality, recency, cross-references; with Ebbinghaus-inspired decay per content-type
  • 5-state lifecycle machine — draft → reviewed → verified → stale → archived with 90-day auto-stale
  • 16 lint rules — 8 structural (frontmatter, link integrity, orphans, freshness, duplicates, index sync…) + 3 LLM-powered (contradictions, claim verification, summary accuracy) + stale_candidates (#51) + tags_topics_convention (#302) + stale_reference_detection (#303) + frontmatter_count_consistency (#378) + tools_consistency (#378)
  • Auto Dream — MEMORY.md consolidation after 24h + 5 sessions: resolve relative dates, prune outdated, 200-line cap
  • 9 navigation files — CLAUDE.md, AGENTS.md, MEMORY.md, SOUL.md, CRITICAL_FACTS.md, hints.md, hot.md + per-project hot caches

Obsidian-native experience (v1.0)

  • link-obsidian CLI — symlinks the whole project into an Obsidian vault; graph view + backlinks + full-text search just work
  • Dataview dashboard — 10 ready-to-use queries (recently updated, by confidence, by lifecycle, by project, by entity type, open questions, stale pages)
  • Templater templates — 4 templates for source/entity/concept/synthesis pages, seeded with confidence + lifecycle + today's date
  • Category pages — tag-based index pages in both Dataview (Obsidian) and static markdown (HTML) modes
  • Integration guide — docs/obsidian-integration.md covers 6 recommended plugins with per-plugin configs

Automation

  • SessionStart hook — auto-syncs new sessions in the background on every Claude Code launch
  • Auto-build on sync — /wiki-sync triggers /wiki-build (configurable; default on)
  • One-shot pipeline — llmwiki all runs build → graph → export → lint in a single command (--strict for CI)
  • MCP server — 12 production tools (query, search, list, read, lint, sync, export, + confidence, lifecycle, dashboard, entity search, category browse) queryable from any MCP client (Claude Desktop, Cline, Cursor, ChatGPT desktop)
  • Pending ingest queue — SessionStart hook converts + queues; /wiki-sync processes queue
  • No servers, no database, no npm — Python stdlib + markdown. Syntax highlighting loads from a highlight.js CDN at view time.

Tutorial — every command in 90 seconds

A guided tour. Run these in order and you'll have a fully working wiki at http://127.0.0.1:8765/ by the end. Each command is idempotent and prints what it did.

A scripted recording of the same flow ships at docs/videos/cli-tutorial.gif (31 seconds against an 8-session sandbox). The reproducible source is docs/videos/cli-tutorial.tape — re-render anytime with vhs docs/videos/cli-tutorial.tape.

# 1. One-time scaffold (≈1 sec). Creates raw/, wiki/, site/, seed nav files.
llmwiki init

# 2. Pull in your sessions (≈1 sec / 100 sessions). Walks every adapter
#    that's "available" on this machine (Claude Code, Codex CLI, Cursor,
#    Gemini, Obsidian, Copilot Chat / CLI), converts new .jsonl files to
#    raw/sessions/*.md, then runs build + lint by default.
llmwiki sync

# 3. Compile the static HTML site (≈3 sec on a 500-session corpus).
#    Already runs as part of `sync`; call directly when you're iterating
#    on a wiki/ page and don't need a fresh sync.
llmwiki build

# 4. Browse it locally. Cmd+K opens the search palette; / focuses the
#    filter bar on /sessions/. Press Ctrl+C to stop.
llmwiki serve

# 5. (Optional) Generate the knowledge graph + AI-consumable exports.
#    `all` runs build → graph → export → lint in one shot.
llmwiki graph
llmwiki export all
llmwiki all     # one-shot equivalent of build + graph + export + lint

That's the entire happy path. Two more commands you'll reach for occasionally:

# Inspect what's installed + configured. Prints a per-adapter table:
# (available: yes/no, configured: yes/no, session-store path).
llmwiki adapters

# Lint the wiki. 16 rules — broken wikilinks, orphaned pages, stale
# summaries, duplicate detection, freshness, missing entities, etc.
# Runs as part of `sync` by default; call directly for a one-shot check.
llmwiki lint

Three optional flags you'll discover later:

  • --adapter <name> — limit sync to one adapter (e.g. --adapter claude_code)
  • --vault PATH — write into an Obsidian / Logseq vault overlay instead of wiki/ (#54)
  • --synthesize — call out to a local Claude / Ollama backend during build for an LLM-generated overview page

Each subcommand has its own --help with the rest. The CLI reference table below is the full list.

How it works

┌─────────────────────────────────────┐
│  ~/.claude/projects/*/*.jsonl       │  ← Claude Code sessions
│  ~/.codex/sessions/**/*.jsonl       │  ← Codex CLI sessions
│  ~/Library/.../Cursor/workspaceS…   │  ← Cursor
│  ~/Documents/Obsidian Vault/        │  ← Obsidian
│  ~/.gemini/                         │  ← Gemini CLI
└──────────────┬──────────────────────┘
               │
               ▼   python3 -m llmwiki sync
┌─────────────────────────────────────┐
│  raw/sessions/<project>/            │  ← immutable markdown (Karpathy layer 1)
│     2026-04-08-<slug>.md            │
└──────────────┬──────────────────────┘
               │
               ▼   /wiki-ingest  (your coding agent)
┌─────────────────────────────────────┐
│  wiki/sources/<slug>.md             │  ← LLM-generated wiki (Karpathy layer 2)
│  wiki/entities/<Name>.md            │
│  wiki/concepts/<Name>.md            │
│  wiki/syntheses/<Name>.md           │
│  wiki/comparisons/<Name>.md         │
│  wiki/questions/<Name>.md           │
│  wiki/index.md, overview.md, log.md │
└──────────────┬──────────────────────┘
               │
               ▼   python3 -m llmwiki build
┌─────────────────────────────────────┐
│  site/                              │  ← static HTML + AI exports
│  ├── index.html, style.css, ...     │
│  ├── sessions/<project>/<slug>.html │
│  ├── sessions/<project>/<slug>.txt  │  (AI sibling)
│  ├── sessions/<project>/<slug>.json │  (AI sibling)
│  ├── llms.txt, llms-full.txt        │
│  ├── graph.jsonld                   │
│  ├── sitemap.xml, rss.xml           │
│  ├── robots.txt, ai-readme.md       │
│  ├── manifest.json                  │
│  └── search-index.json              │
└─────────────────────────────────────┘

See docs/architecture.md for the full 3-layer Karpathy + 8-layer build breakdown.

Documentation

Full production documentation lives under docs/. The editorial hub is docs/index.md — tutorials, per-agent guides, reference, and deployment, all in one place.

Start here:

GoalRead
Install and build your first site in 10 minutesTutorial 01 → 02
Use llmwiki with Claude CodeTutorial 03
Use llmwiki with Codex CLITutorial 04
Query / lint / review your wiki dailyTutorial 05
Point llmwiki at an existing Obsidian / Logseq vaultTutorial 06
See four real end-to-end workflowsTutorial 07

Contributing to docs? See the style guide.

Install

macOS / Linux

git clone https://github.com/Pratiyush/llm-wiki.git
cd llm-wiki
./setup.sh

Windows

git clone https://github.com/Pratiyush/llm-wiki.git
cd llm-wiki
setup.bat

With pip (v0.3+)

pip install -e .                # basic — everything you need
pip install -e '.[graph]'       # + graphifyy AI-powered graph engine
pip install -e '.[dev]'         # + pytest + ruff
pip install -e '.[e2e]'         # + Playwright + pytest-bdd + pytest-html (E2E)
pip install -e '.[all]'         # graph + everything

Syntax highlighting is now powered by highlight.js, loaded from a CDN at view time — no optional deps required.

What setup does

  1. Creates raw/, wiki/, site/ data directories
  2. Installs the llmwiki Python package in-place
  3. Detects your coding agents and enables matching adapters
  4. Optionally offers to install the SessionStart hook into ~/.claude/settings.json for auto-sync
  5. Runs a first sync so you see output immediately

For maintainers

Running the project? The governance scaffold lives under docs/maintainers/ and is loaded by a dedicated skill:

FileWhat it's for
CONTRIBUTING.mdShort rules for contributors — read this first
CODE_OF_CONDUCT.mdContributor Covenant 2.1
SECURITY.mdDisclosure process for redaction bugs, XSS, data leaks
docs/maintainers/ARCHITECTURE.mdOne-page system diagram + layer boundaries + what NOT to add
docs/maintainers/REVIEW_CHECKLIST.mdCanonical code-review criteria
docs/maintainers/RELEASE_PROCESS.mdVersion bump → CHANGELOG → tag → build → publish
docs/maintainers/TRIAGE.mdLabel taxonomy + stale-issue policy
docs/maintainers/ROADMAP.mdNear-term plan + release themes
docs/maintainers/DECLINED.mdGraveyard of declined ideas with reasons

Four Claude Code slash commands automate the common ops:

  • /review-pr <N> — apply the REVIEW_CHECKLIST to a PR and post findings
  • /triage-issue <N> — label + milestone + priority a new issue
  • /release <version> — walk the release process step by step
  • /maintainer — meta-skill that loads every governance doc as context

Running E2E tests

The unit suite (pytest tests/ — 2,651 tests) runs in seconds and covers every module. The end-to-end suite under tests/e2e/ is separate: it builds a minimal demo site, serves it on a random port, drives a real browser via Playwright, and runs scenarios written in Gherkin via pytest-bdd.

Why both? Unit tests lock the contract at the module boundary; E2E locks the contract at the user's browser. A diff that passes unit tests but breaks the Cmd+K palette will fail E2E.

Install the extras (one-time, several hundred MB for the Chromium binary):

pip install -e '.[e2e]'
python -m playwright install chromium

Run the suite:

pytest tests/e2e/ --browser=chromium

Run a single feature:

pytest tests/e2e/test_command_palette.py --browser=chromium -v

The E2E suite is excluded from the default pytest tests/ run (see the --ignore=tests/e2e addopt in pyproject.toml) so you can iterate on the unit suite without waiting for browser installs. CI runs the E2E job as a separate workflow (.github/workflows/e2e.yml) that only fires on PRs touching build.py, the viz modules, or tests/e2e/**.

Feature files live under tests/e2e/features/ — one per UI area (homepage, session page, command palette, keyboard nav, mobile nav, theme toggle, copy-as-markdown, responsive breakpoints, edge cases, accessibility, visual regression). Step definitions are all in tests/e2e/steps/ui_steps.py. Adding a new scenario is usually a 2-line change to a .feature file plus maybe one new step.

Run locally with an HTML report:

pytest tests/e2e/ --browser=chromium \
  --html=e2e-report/index.html --self-contained-html
open e2e-report/index.html     # macOS — opens the browseable report

Where to see test reports:

WhatWhere
Unit test resultsGitHub Actions → ci.yml → latest run → lint-and-test job logs
E2E HTML reportGitHub Actions → e2e.yml → latest run → Artifacts → e2e-html-report (14-day retention)
Visual regression screenshotsSame run → Artifacts → e2e-screenshots
Playwright traces (failed runs only)Same run → Artifacts → playwright-traces (open with playwright show-trace <zip>)
Demo site deploy statusGitHub Actions → pages.yml → latest run

Locally, the HTML report is one file (e2e-report/index.html) that you can open in any browser — pass/fail per scenario, duration, stdout/stderr, screenshot on failure.

Scheduled sync

For a daily / weekly cron-style sync, schedule llmwiki sync directly via your OS's native job runner (launchd on macOS, systemd on Linux, Task Scheduler on Windows). Paths and adapter selection come from examples/sessions_config.json.

CLI reference

llmwiki init                    # scaffold raw/ wiki/ site/ + seed nav files
llmwiki sync                    # convert .jsonl → markdown (auto-build + auto-lint if configured)
llmwiki build                   # compile static HTML + AI exports
llmwiki serve                   # local HTTP server on 127.0.0.1:8765
llmwiki adapters                # list available adapters + configured state (v1.0)
llmwiki graph                   # build knowledge graph (v0.2)
llmwiki lint                    # 16-rule wiki lint (v1.2)
llmwiki export <format>         # AI-consumable exports (v0.4)
llmwiki synthesize              # auto-ingest synthesis pipeline (v0.5)
llmwiki all                     # build → graph → export → lint in one shot (v1.2)
llmwiki version

Each subcommand has its own --help. All commands are also wrapped in one-click shell/batch scripts: sync.sh/.bat, build.sh/.bat, serve.sh/.bat, upgrade.sh/.bat.

Works with

AgentAdapterStatusAdded in
Claude Codellmwiki.adapters.claude_code✅ Productionv0.1
Obsidian (input)llmwiki.adapters.obsidian✅ Productionv0.1
Obsidian (output)llmwiki.obsidian_output✅ Productionv0.2
Codex CLIllmwiki.adapters.codex_cli✅ Productionv0.3
Cursorllmwiki.adapters.cursor🧪 Beta — needs verification against current Cursor session formatv0.5
Gemini CLIllmwiki.adapters.gemini_cli🧪 Beta — layout TBCv0.5
Copilot Chatllmwiki.adapters.copilot_chat🧪 Betav0.9
Copilot CLIllmwiki.adapters.copilot_cli🧪 Betav0.9
OpenCode / OpenClaw—⏸ Deferred—

Adding a new agent is one small file — subclass BaseAdapter, declare SUPPORTED_SCHEMA_VERSIONS, ship a fixture + snapshot test.

MCP server

llmwiki ships its own MCP server (stdio transport, no SDK dependency) so any MCP client can query your wiki directly.

python3 -m llmwiki.mcp   # runs on stdin/stdout

Twelve production tools (7 core + 5 added in v1.0 #159):

ToolWhat
wiki_query(question, max_pages)Keyword search + page content (no LLM synthesis)
wiki_search(term, include_raw)Raw grep over wiki/ (+ optional raw/)
wiki_list_sources(project)List raw source files with metadata
wiki_read_page(path)Read one page (path-traversal guarded)
wiki_lint()Orphans + broken-wikilinks report
wiki_sync(dry_run)Trigger the converter
wiki_export(format)Return any AI-consumable export (llms.txt, jsonld, sitemap, rss, manifest)
wiki_confidence(min, max)Pages by confidence range (v1.0)
wiki_lifecycle(state)Pages by draft/reviewed/verified/stale/archived (v1.0)
wiki_dashboard()Health summary: counts by type, lifecycle, confidence (v1.0)
wiki_entity_search(name, entity_type)Search entities by name substring or type (v1.0)
wiki_category_browse(tag)Browse tags with counts, drill into specific tag (v1.0)

Register in your MCP client's config — e.g. for Claude Desktop, add to ~/Library/Application Support/Claude/claude_desktop_config.json:

{
  "mcpServers": {
    "llmwiki": {
      "command": "python3",
      "args": ["-m", "llmwiki.mcp"]
    }
  }
}

Configuration

Single JSON config at examples/sessions_config.json. Copy to config.json and edit:

{
  "filters": {
    "live_session_minutes": 60,
    "exclude_projects": []
  },
  "redaction": {
    "real_username": "YOUR_USERNAME",
    "replacement_username": "USER",
    "extra_patterns": [
      "(?i)(api[_-]?key|secret|token|bearer|password)...",
      "sk-[A-Za-z0-9]{20,}"
    ]
  },
  "truncation": {
    "tool_result_chars": 500,
    "bash_stdout_lines": 5
  },
  "adapters": {
    "obsidian": {
      "vault_paths": ["~/Documents/Obsidian Vault"]
    }
  }
}

All paths, regexes, truncation limits, and per-adapter settings are tunable. See docs/configuration.md.

.llmwikiignore

Gitignore-style pattern file at the repo root. Skip entire projects, dates, or specific sessions without touching config:

# Skip a whole project
confidential-client/
# Skip anything before a date
*2025-*
# Keep exception
!confidential-client/public-*

Karpathy's LLM Wiki pattern

This project follows the three-layer structure described in Karpathy's gist:

  1. Raw sources (raw/) — immutable. Session transcripts converted from .jsonl.
  2. The wiki (wiki/) — LLM-generated. One page per entity, concept, source. Interlinked via [[wikilinks]].
  3. The schema (CLAUDE.md, AGENTS.md) — tells your agent how to ingest and query.

See docs/architecture.md for the full breakdown and how it maps to the file tree.

Design principles

  • Stdlib first — only mandatory runtime dep is markdown. Optional extras (graph, dev, e2e) layer in graph engines, lint/test tooling, and Playwright on top.
  • Works offline — no Google fonts, no external CSS. Syntax highlighting loads from a highlight.js CDN but degrades gracefully without it.
  • Redact by default — username, API keys, tokens, emails all get redacted before entering the wiki.
  • Idempotent everything — re-running any command is safe and cheap.
  • Agent-agnostic core — the converter doesn't know which agent produced the .jsonl; adapters translate.
  • Privacy by default — localhost-only binding, no telemetry, no cloud calls.
  • Dual-format output (v0.4) — every page ships both for humans (HTML) and AI agents (TXT + JSON + JSON-LD + sitemap + llms.txt).

Docs

Per-adapter docs:

Releases

VersionFocusTag
v0.1.0Core release — Claude Code adapter, god-level HTML UI, schema, CI, plugin scaffoldingv0.1.0
v0.2.0Extensions — 3 new slash commands, 3 new adapters, Obsidian bidirectional, full MCP serverv0.2.0
v0.3.0PyPI packaging, eval framework, i18n scaffoldv0.3.0
v0.4.0AI + human dual format — per-page .txt/.json siblings, llms.txt, JSON-LD graph, sitemap, RSS, schema.org microdata, reading time, related pages, activity heatmap, deep-link anchors, build manifest, link checker, wiki_export MCP toolv0.4.0
v0.5.0 – v0.9.0Internal sprint milestones — features (_context.md, auto-ingest, qmd export, model-profile schema, activity heatmap, Copilot adapters, etc.) shipped consolidated under the v0.9.x line. No standalone tags were published.—
v0.9.1Sprint 1 & 2 foundation — link-obsidian CLI, 4-factor confidence scoring, 5-state lifecycle machine, llmbook-reference skill, 7 entity types, flat raw/ naming, pending ingest queue, _context.md stubs, meeting + Jira adapters, configurable Web Clipper intake, rich log formatv0.9.1
v0.9.2Sprint 3 quality — 11 lint rules (8 basic + 3 LLM-powered), Auto Dream MEMORY.md consolidation, Dataview dashboard template, category pages (Dataview + static), auto-build on sync + configurable lint schedulev0.9.2
v0.9.3Sprint 3 polish — Obsidian Templater templates, integration guide, two-way editing tests, MCP server 7→12 tools, adapter config validation, pipeline fix (sigstore, PyPI gate)v0.9.3
v0.9.4Session C1 (Sprint 4) — multi-agent skill installer, enhanced search with facets, configurable scheduled sync (launchd/systemd/Task Scheduler), CI wiki-checks workflowv0.9.4
v0.9.5Docs polish + consistency audit before v1.0.0v0.9.5
v1.0.0Production-ready Obsidian integration — full v1.0 scopev1.0.0
v1.1.0-rc1Solo quick-win sprint — candidates workflow, Ollama scaffold, prompt-cache scaffoldv1.1.0-rc1
v1.1.0-rc2Session E — interactive graph viewer + remaining code-only v1.1 workv1.1.0-rc2
v1.1.0-rc3Gap-sweep bundle — state portability, quarantine, sync --status, log CLI, synthesize --estimate breakdown, tag family, stale references, graph context menu, raw immutability, AI-sessions defaultv1.1.0-rc3
v1.1.0-rc4Navigation + quality — graph site_url resolver (99.7% → 0% dead clicks), llmwiki backlinks CLI (95% → 0% orphan pages), source-code → GitHub link rewriter (471 → 100 broken), verify-before-fixing contribution rulev1.1.0-rc4
v1.1.0-rc5Site audit + 5 closed batches — session-local ref stripping (351 → 247 broken), cheatsheet, README/CONTRIBUTING compile, expanded E2E, slash-CLI parity test, 4 adapter docs, Ollama tutorial, dual-mode docs skeleton, /wiki-synthesize slashv1.1.0-rc5
v1.1.0-rc6rc6 batch — fixed adapter tag hardcoded to claude-code for every adapter (#346), tutorial UX polish with in-page TOC + prev/next + edit-on-GitHub (#282), command palette now indexes 107 doc pages + 17 slash commands (#277), content-hash cache for md_to_html (#283)v1.1.0-rc6
v1.1.0-rc7rc7 batch — automatic AI-suggested tags during synthesis (#351), link-checker config fix (#348, #350, #353)v1.1.0-rc7
v1.1.0-rc8rc8 batch — complete Mode B agent-delegate backend (#316): new llmwiki synthesize --list-pending + --complete <uuid> CLI subcommands, /wiki-sync step 6 auto-detects pending prompts, Mode B ships end-to-end without an API keyv1.1.0-rc8
v1.2.0First stable on the 1.x line — llmwiki all one-shot pipeline runner, Playwright + axe-core E2E suite (#384), project-stub auto-seeding, 2 new lint rules, critical export-fidelity + sync-collision fixes, 10 UX-critique items (#387). PyPI distribution name: llm-notebook.v1.2.0

Roadmap

Shipped milestones:

  • v0.5.0 — Folder-level _context.md, auto-ingest, adapter graduations, lazy search index, scheduled sync, WCAG, E2E tests (milestone)
  • v0.6.0 — qmd export, GitLab Pages CI, PyPI release automation, maintainer governance scaffold (milestone)
  • v0.7.0 — Structured model-profile schema, vs-comparison pages, append-only changelog timeline (milestone)
  • v0.8.0 — 365-day activity heatmap, tool-calling bar chart, token usage card, session metrics frontmatter (milestone)
  • v0.9.0 — Project topics, agent labels, Copilot adapters, image pipeline, highlight.js, public demo deployment
  • v0.9.x — Sprint 1-4 foundation for v1.0.0 Obsidian integration: confidence scoring, lifecycle state machine, 9 navigation files, 11 lint rules, Auto Dream, Dataview dashboard, multi-agent skills, 12-tool MCP server, meeting + Jira adapters

Active milestones:

MilestoneFocusTracking
v1.0.0Final docs polish + PyPI trusted publisher + releaseMilestone
v1.1.0Ollama backend, prompt caching, interactive graph viewer, Homebrew tapMilestone
v1.2.0ChatGPT + OpenCode adapters, vault-overlay mode, tree-aware search, cache tiersMilestone

Deployment targets

Acknowledgements

License

MIT © Pratiyush

Repozitoriyni ochish ↗