Name: hermes-dojo
Author: Yonkoo11

Imported from Yonkoo11/hermes-dojo (SKILL.md). Install upstream with npx skills add Yonkoo11/hermes-dojo. Copyright stays with the author (MIT).

Overview

Hermes Dojo is your agent's training gym. It reads your past sessions, finds where the agent struggles, creates or improves skills to fix those weaknesses, and tracks improvement over time.

The core loop: measure → identify weakness → fix → evolve → verify → report

Commands

/dojo or /dojo analyze — Analyze recent sessions for failure patterns
/dojo improve — Fix the top weaknesses (patch skills + run self-evolution)
/dojo report — Show current performance metrics and improvement history
/dojo history — Show learning curve over time
/dojo auto — Set up overnight cron: analyze + improve + report at 6am
/dojo status — Quick summary of agent health

Workflow

Step 1: Analyze

Run python3 ~/.hermes/skills/hermes-dojo/scripts/monitor.py to scan recent sessions.

This reads ~/.hermes/state.db and produces a JSON report with:

Per-tool success/failure rates
Error patterns (grouped by tool and error type)
User correction signals (messages containing "no,", "wrong", "I meant", "not what I")
Skill gap detection (repeated manual tasks with no skill)
Session-level metrics (tool calls per session, retry patterns)

Present the results as a clear dashboard:

=== Hermes Dojo Analysis ===
Sessions analyzed: 23 (last 7 days)
Total tool calls: 156
Overall success rate: 78%

Top Weaknesses:
1. terminal_run: 73% success (12 failures) — common error: "command not found"
2. web_extract: 81% success (4 failures) — common error: "timeout"
3. No skill for: CSV parsing (requested 4 times)

User Corrections Detected: 7
- 3x wrong file path
- 2x wrong command syntax
- 2x misunderstood request

Step 2: Improve

For each identified weakness, decide the fix:

A) Existing skill fails → patch it:

Read the current skill's SKILL.md
Analyze the failure patterns from Step 1
Use skill_manage with action "patch" to add error handling, better instructions, or edge case coverage
Log the change

B) No skill exists for a recurring need → create one:

Analyze the session patterns where this capability was needed
Use skill_manage with action "create" to make a new skill
Include specific instructions based on what worked in past sessions
Log the creation

C) Skill exists but needs deeper improvement → run self-evolution:

Run: cd ~/.hermes/hermes-agent-self-evolution && .venv/bin/python3 -m evolution.skills.evolve_skill --skill <name> --hermes-repo ~/.hermes --iterations 5 --eval-source synthetic
This uses GEPA to analyze execution traces and propose targeted improvements
Review the evolution output — accept if score improved
Log before/after scores

Step 3: Verify

After improvements:

Re-run monitor.py to compute new metrics
Compare before/after success rates
If improvement < 5%, flag for manual review
Store results in metrics history

Step 4: Report

Run python3 ~/.hermes/skills/hermes-dojo/scripts/reporter.py to generate a report.

Format for Telegram delivery:

🥋 Hermes Dojo — Overnight Report

📊 Analyzed: 23 sessions, 156 tool calls
📈 Overall: 78% → 85% (+7%)

✅ Improved:
  • terminal_run: 73% → 96% (added PATH check)
  • web_extract: 81% → 95% (added retry + timeout)

🆕 New skill created:
  • csv-handler: for CSV parsing you keep asking about

⚠️ Still working on:
  • File path resolution (need more examples)

📉 Learning curve: 71% → 78% → 85% (3 days)

Step 5: Track

Run python3 ~/.hermes/skills/hermes-dojo/scripts/tracker.py save to persist metrics. Run python3 ~/.hermes/skills/hermes-dojo/scripts/tracker.py history to show the learning curve.

Setting Up Overnight Cron

When the user says /dojo auto:

Set up a cron job that runs at 6:00 AM daily: "Run /dojo analyze, then /dojo improve on the top 3 weaknesses, then send the report to my home channel."

This makes the agent literally improve while you sleep.

Important Notes

Never modify bundled skills (in hermes-agent/skills/). Only modify user skills in ~/.hermes/skills/
Self-evolution requires ~/.hermes/hermes-agent-self-evolution to be cloned
Metrics are stored in ~/.hermes/skills/hermes-dojo/data/metrics.json
Each analysis run is timestamped so you can track improvement over days/weeks

Install hermes-dojo and it becomes one more candidate the router can pick - when it fits.

A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.

{ "ocm": "1", "id": "yonkoo11-hermes-dojo-hermes-dojo", "kind": "skill", "name": "hermes-dojo", "description": "Continuous self-improvement system for Hermes Agent. Analyzes your past sessions to find recurring failures and skill gaps, then automatically creates or patches skills and runs self-evolution to fix them. Set it to run overnight and wake up to a better agent. Use /dojo to start.", "publisher": "Yonkoo11", "version": "1.0.0", "capabilities": { "domains": [ "general" ], "tags": [ "skill-md", "github" ], "languages": [ "en" ] }, "quality_prior": 0.6, "examples": [ "Continuous self-improvement system for Hermes Agent. Analyzes your past sessions to find recurring failures and skill gaps, then automatically creates or patches skills and runs self-evolution to fix them. Set it to run overnight and wake up to a better agent. Use /dojo to start." ], "primary": false, "metadata": { "source": { "provider": "github", "repository": "https://github.com/Yonkoo11/hermes-dojo", "path": "SKILL.md", "ref": "ee114e72e18b13d3aeb4b76a8d1ade0916972248", "url": "https://github.com/Yonkoo11/hermes-dojo/blob/ee114e72e18b13d3aeb4b76a8d1ade0916972248/SKILL.md", "key": "Yonkoo11/hermes-dojo/SKILL.md" }, "allowed_tools": [ "Bash(python3:*)", "Read", "Write", "skill_manage", "delegate_task", "session_search", "memory" ], "license": "MIT" }, "instructions": "## Overview\n\nHermes Dojo is your agent's training gym. It reads your past sessions, finds where\nthe agent struggles, creates or improves skills to fix those weaknesses, and tracks\nimprovement over time.\n\nThe core loop: **measure → identify weakness → fix → evolve → verify → report**\n\n## Commands\n\n- `/dojo` or `/dojo analyze` — Analyze recent sessions for failure patterns\n- `/dojo improve` — Fix the top weaknesses (patch skills + run self-evolution)\n- `/dojo report` — Show current performance metrics and improvement history\n- `/dojo history` — Show learning curve over time\n- `/dojo auto` — Set ", "cost": { "context_tokens": 1066 } }

hermes-dojo

About