Skip to content
Skillv1.0.0

lesson 11

Teach reward misspecification and constrained policy selection.

by narcolepticchicken(0) 0 installs
Free
Sign in to install

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

Imported from narcolepticchicken/teacherlab (lesson 11/AGENTS.md). Install upstream with npx skills add narcolepticchicken/teacherlab --skill lesson 11. Copyright stays with the author.

Lesson 11 Agent Notes

Teach reward misspecification and constrained policy selection.

  • Keep proxy reward and safety cost as separate signals.
  • Never treat a hard authority constraint as an ordinary tradeable penalty.
  • Report both expected reward and violation rate for every policy.
  • State that all distributions and values are invented.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml
targets:
  - https://api.opensmartroute.ai/api/v1/registry/narcolepticchicken-teacherlab-lesson-11/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

narcolepticchicken-teacherlab-lesson-11.ocm.jsonjson
{
  "ocm": "1",
  "id": "narcolepticchicken-teacherlab-lesson-11",
  "kind": "skill",
  "name": "lesson 11",
  "description": "Teach reward misspecification and constrained policy selection.",
  "publisher": "narcolepticchicken",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "general"
    ],
    "tags": [
      "skill-md",
      "github-agents"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Teach reward misspecification and constrained policy selection."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "github-agents",
      "repository": "https://github.com/narcolepticchicken/teacherlab",
      "path": "lesson 11/AGENTS.md",
      "ref": "7beca52851cc8439744373fec273d6c0c7e2b1b4",
      "url": "https://github.com/narcolepticchicken/teacherlab/blob/7beca52851cc8439744373fec273d6c0c7e2b1b4/lesson 11/AGENTS.md",
      "key": "narcolepticchicken/teacherlab/lesson 11/AGENTS.md"
    }
  },
  "instructions": "# Lesson 11 Agent Notes\n\nTeach reward misspecification and constrained policy selection.\n\n- Keep proxy reward and safety cost as separate signals.\n- Never treat a hard authority constraint as an ordinary tradeable penalty.\n- Report both expected reward and violation rate for every policy.\n- State that all distributions and values are invented.",
  "cost": {
    "context_tokens": 86
  }
}

Fetch it by URL: GET /api/v1/registry/narcolepticchicken-teacherlab-lesson-11/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.