Skip to content
Skillv1.0.0

llm-council

Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer.

by sickn33(0) 0 installs
Free
Sign in to install

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

Imported from sickn33/agentic-awesome-skills (skills/llm-council/SKILL.md). Install upstream with npx skills add sickn33/agentic-awesome-skills --skill llm-council. Copyright stays with the author (MIT).

LLM Council (Fireworks AI)

Detailed Guide

Read the detailed guide before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely.

When to Use

Use when this workflow matches the user request: Use this skill for its documented workflow.

Source: dair-ai/dair-academy-plugins (MIT).

This skill implements Karpathy's LLM Council concept where multiple open-weight LLMs deliberate on a query, powered entirely by Fireworks AI:

  1. Phase 1: All models respond to the query independently (parallel)
  2. Phase 2: Models rank each other's anonymized responses
  3. Phase 3: A Chairman LLM synthesizes the final answer

All inference runs through Fireworks AI using open-weight models. The speed and pricing of Fireworks makes it practical to run multi-model deliberation that would be slow or expensive on other providers.

CRITICAL RULES

  1. ALWAYS use AskUserQuestion to let the user select council models (multiselect) and the Chairman model
  2. ALWAYS save raw responses to files - never summarize or truncate API outputs
  3. ALWAYS show full transparency - display all individual responses, all rankings, AND the final synthesis
  4. NEVER skip the ranking phase - it is essential to the council deliberation process
  5. Read from files for display - ensures content is shown unmodified
  6. ALWAYS display the final output to the user after Phase 3 completes

Limitations

  • Requires the upstream tool, account, API key, or local setup when the workflow names one.
  • Does not authorize destructive, production, paid, or external-message actions without explicit user approval.
  • Validate generated artifacts or recommendations against the user's real sources before treating them as final.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml
targets:
  - https://api.opensmartroute.ai/api/v1/registry/sickn33-agentic-awesome-skills-llm-council/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

sickn33-agentic-awesome-skills-llm-council.ocm.jsonjson
{
  "ocm": "1",
  "id": "sickn33-agentic-awesome-skills-llm-council",
  "kind": "skill",
  "name": "llm-council",
  "description": "Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer.",
  "publisher": "sickn33",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "general"
    ],
    "tags": [
      "skill-md",
      "dair-academy",
      "ai",
      "workflow",
      "skills-sh"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Run Fireworks-hosted open-weight model councils that compare responses and synthesize a final answer."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "skills.sh",
      "repository": "https://github.com/sickn33/agentic-awesome-skills",
      "path": "skills/llm-council/SKILL.md",
      "ref": "HEAD",
      "url": "https://github.com/sickn33/agentic-awesome-skills/blob/HEAD/skills/llm-council/SKILL.md",
      "key": "sickn33/agentic-awesome-skills/skills/llm-council/SKILL.md"
    },
    "allowed_tools": [
      "Read,",
      "Write,",
      "Bash,",
      "AskUserQuestion"
    ],
    "license": "MIT"
  },
  "instructions": "# LLM Council (Fireworks AI)\n\n## Detailed Guide\n\nRead [the detailed guide](references/detailed-guide.md) before executing this skill. It retains the complete procedure and reference material. Treat its safety, prerequisites, and validation requirements as mandatory. For focused work, load the relevant sections; for end-to-end work, read the guide completely.\n\n## When to Use\n\nUse when this workflow matches the user request: Use this skill for its documented workflow.\n\n\n_Source: [dair-ai/dair-academy-plugins](https://github.com/dair-ai/dair-academy-plugins) (MIT)._\n\nThis skill implements Karpath",
  "cost": {
    "context_tokens": 503
  }
}

Fetch it by URL: GET /api/v1/registry/sickn33-agentic-awesome-skills-llm-council/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.