SkillForge

From public sources

A skill creator that proves its skills work. Evidence-driven skill creation for Claude Code and Codex: baseline-tested generation, per-skill regression evals, ecosystem doctor, cross-runtime compile, and an opt-in proactive advisor.

AI skillCategory: AI Skills · Skill collections · Software engineering · Testing & QAOpen sourcedata checked Oct 15, 2026

Overview

  • agent-skills
  • claude-ai
  • claude-code
  • claude-skills
  • codex
  • evals

Installation

Commands are shown, never run by the marketplace. Check them against the official documentation.
  • Build from sourceFrom public sourcesfrom catalog metadata

    Build from source: no validated build recipe — follow the repository instructions.

    github.com/tripleyak/SkillForge ↗

Compatibility

Unknown means no evidence was found — not that the product is incompatible.
PlatformStatusArchitectureEvidenceConfidence
Claude CodeUnknown———
Claude (web & desktop)Unknown———
OpenAI CodexUnknown———
ChatGPTUnknown———
CursorUnknown———
GitHub CopilotUnknown———
Gemini CLIUnknown———

Releases

checked Oct 29, 2026
v6.0.0LatestJul 29, 2026Official source ↗

Files in 6.0.0

This release has no attached files.

Release history

Quality profile

algorithm quality-v1.0 · assessed Oct 15, 2026
Quality Score82
Risk Score0
Confidence 1.00
Quality Score and Risk Score are different measures. A high score does not guarantee safety.

Score components

Maintenance · 2016
last activity 78 days ago
Documentation · 1515
README 5291 chars, description present
Ready to use · 156
install instructions: no; releases: yes
Metadata · 108
3/4 of description, homepage, license, topics
Releases · 1010
5 release(s), latest 78 days ago
Category confidence · 1010
classifier confidence 0.97
Adoption · 107
909 stars (log-dampened, 10k = max)
License clarity · 55
SPDX MIT
Community · 55
issues enabled, 93 forks

License

MIT
Known licensefrom the repository host

This is the catalog policy status, not legal advice.

Sources

github.com/tripleyak/SkillForgePrimary★ 909 starslast activity Jul 29, 2026Primary repository · Confidence 1.00

Reviews

Sign in to write a review

No reviews yet.

Alternatives

README

From tripleyak/SkillForge · license MIT · fetched Oct 29, 2026

SkillForge v6

A skill creator that proves its skills work.

SkillForge routes any skill-related request (use, improve, create, compose), creates new skills through an evidence-driven pipeline, and maintains the health of your whole skill ecosystem. Its core principle: skill quality is a property of behavior, not documents - a skill is done when a fresh agent demonstrably does better with it than without it.

What v6 changed (and why)

v6 is a ground-up rework following a deep external audit (see SKILLFORGE_AUDIT.md on the repo, not shipped with the skill). The headline shifts:

v5v6
4-agent "unanimous synthesis panel" reads the skillSkills are executed: baseline (RED) runs before writing, with-skill (GREEN) runs after, behavioral delta is the gate
Self-scored "timelessness >= 7" approvalFalsifiable checks moved to lint (validate_skill.py); one adversarial reviewer refutes what lint can't catch
5,049-word SKILL.md with <details> "progressive disclosure"1,158-word SKILL.md; depth lives in references/ loaded on demand
Descriptions = "what this skill does"Descriptions = trigger conditions only (workflow summaries make agents skip the body)
launchd background advisor that analyzed / and queued into a file nothing readAdvisor delivered through Claude Code hooks (SessionStart + UserPromptSubmit), caps enforced, opt-in
Personal-directory scanning on by default, hardcoded GitHub handlesPersonal Context strictly opt-in with recorded consent; no shipped defaults
Hand-rolled YAML parser that failed SkillForge's own SKILL.mdOne shared typed parser (scripts/frontmatter.py), 100+ unit tests, and a regression test that SkillForge validates itself
Index missed the Claude Code plugin cache entirelyCross-runtime discovery: personal, Codex, Claude Code plugin cache; deduped; auto-refresh

The pipeline

Phase 0  TRIAGE      index + word-boundary matching -> USE | IMPROVE | CREATE | COMPOSE | CLARIFY
Phase 0b RED GATE    fresh subagent attempts the task WITHOUT the skill; no failure = no skill
Phase 1  ANALYSIS    load-bearing lenses (Inversion, Pareto, Root Cause), failure-form matching
Phase 2  SPEC        tiered (minimal default / full for infrastructure), decisions + WHY
Phase 3  GENERATE    fresh-context subagent receives ONLY the spec + baseline failures
Phase 4  GREEN GATE  with-skill runs must clear the recorded baseline failures; trigger tests
Phase 5  REVIEW      lint (validate_skill.py) + ONE adversarial reviewer charged to refute
Phase 6  SHIP        with evals/ - a per-skill regression suite runnable forever after

What no other skill creator has

  • Dedup before create (Phase 0): an index of every skill across runtimes answers "should this exist?" first.
  • Skills ship with their tests: evals/ (trigger queries + behavioral scenarios) + run_skill_evals.py = regression testing for skills.
  • Ecosystem doctor: skillforge_doctor.py finds trigger collisions between skills, duplicates, stale file references, budget violations, and pinned models across your entire roster.
  • Cross-runtime compile: author once, compile_skill.py --target claude|codex|agentskills.
  • Friction mining (opt-in): mine_skill_friction.py --consent finds skill gaps in your own local session history.
  • Proactive advisor (opt-in): evidence-backed skill suggestions delivered via hooks, never auto-invoked.

Install (Claude Code)

git clone https://github.com/tripleyak/SkillForge.git /tmp/skillforge
cp -r /tmp/skillforge ~/.claude/skills/skillforge
cd ~/.claude/skills/skillforge && rm -rf README.md LICENSE CONTEXT.md docs .git .gitignore .skillignore index.html assets/images scripts/tests SKILLFORGE_AUDIT.md
cp /tmp/skillforge/commands/skillforge.md ~/.claude/commands/skillforge.md   # optional /skillforge command

Optional advisor + hooks (interactive, everything opt-in):

python3 ~/.claude/skills/skillforge/scripts/install_skillforge.py

Requirements: Claude Code (or Codex CLI), Python 3.8+ (stdlib only; PyYAML used if present).

Toolbox

CommandPurpose
python3 scripts/discover_skills.pyBuild/refresh the skill index
python3 scripts/triage_skill_request.py "<request>" --jsonRoute a request
python3 scripts/validate_skill.py <dir>Full validation + lint
python3 scripts/run_skill_evals.py <dir> [--live]Run a skill's regression evals
python3 scripts/skillforge_doctor.pyEcosystem health report
python3 scripts/init_skill.py <name> --path <dir>Scaffold (includes evals/)
python3 scripts/compile_skill.py <dir> --target <t>Cross-runtime compile
python3 scripts/package_skill.py <dir> ./distPackage as .skill
python3 scripts/mine_skill_friction.py --consentMine local transcripts for skill gaps

CI: copy assets/templates/github-workflow-skill-ci.yml into .github/workflows/ of any skill repo.

Releases

Version history and detailed release notes live on the releases page. v6.0.0 is a ground-up rework; the audit that drove it ships in-repo as SKILLFORGE_AUDIT.md.

License

MIT - see LICENSE

Open the repository ↗