About

Imported from sickn33/agentic-awesome-skills (skills/optim-agent/SKILL.md). Install upstream with npx skills add sickn33/agentic-awesome-skills --skill optim-agent. Copyright stays with the author (MIT).

Optim Agent

Name: optim-agent
Author: sickn33

Overview

Use this skill to optimize configurable systems against a measurable scalar objective. It helps an agent turn vague tuning requests into bounded experiments with a defined search space, budget, baseline, and evidence-backed recommendation.

When to Use This Skill

Use when tuning hyperparameters, prompts, inference settings, simulation parameters, quantitative strategies, or RL/control policies.
Use when the objective can be measured as a scalar score, loss, accuracy, cost, latency, reward, or risk-adjusted metric.
Use when the user needs a small-budget optimization loop with trial history, comparisons, and stop criteria.

Do not use this skill when

The objective is purely subjective and cannot be scored consistently.
The user has not provided permission to run experiments or consume compute/API budget.
The task is a one-shot implementation, debugging, or code review request with no configurable search space.

Instructions

Define the optimization target in one sentence: maximize or minimize one scalar metric.
List the tunable parameters, valid ranges, types, defaults, and any forbidden combinations.
Establish at least one baseline before proposing agent-guided trials.
Set the budget up front: number of trials, time, compute, money, or dataset subsample.
Run or request trials one at a time unless the user explicitly approves parallel execution.
Record every trial with parameters, metric value, notes, and failure status.
Compare the best result against the baseline and a simple search strategy when possible.
Stop when the budget is exhausted, the improvement plateaus, or the next trial cannot be justified from evidence.
Report the recommended configuration, measured gain, tradeoffs, and any validation still needed before production use.

Examples

Example 1: Hyperparameter optimization

Tune learning rate, regularization, and tree depth for a credit-default model. Track validation AUC for each trial, compare against the default configuration, and recommend the best setting only if it improves the baseline under the agreed trial budget.

Example 2: Inference tuning

Tune retrieval depth, temperature, and reranker threshold for a RAG workflow. Optimize answer quality under a latency or cost ceiling, then report the best configuration with quality, latency, and cost tradeoffs.

Example 3: Simulation or control

Tune controller gains or environment parameters for a simulator. Optimize reward or error while logging failed trials separately so unstable configurations do not bias the recommendation.

Best Practices

Keep the first run small; expand only after the loop produces useful signal.
Prefer parameters with clear operational meaning over arbitrary knobs.
Treat failed trials as data and record why they failed.
Validate the final configuration on held-out data, a fresh seed, or a separate scenario before calling it robust.
Ask before running expensive, long, or externally billed experiments.

Limitations

This skill does not guarantee a global optimum.
Results depend on objective quality, noise, search-space design, and experiment reproducibility.
Use domain review before applying tuned configurations to production, financial, safety-critical, or user-impacting systems.

Additional Resources

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml

targets:
  - https://api.opensmartroute.ai/api/v1/registry/sickn33-agentic-awesome-skills-optim-agent/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

sickn33-agentic-awesome-skills-optim-agent.ocm.jsonjson

{
  "ocm": "1",
  "id": "sickn33-agentic-awesome-skills-optim-agent",
  "kind": "skill",
  "name": "optim-agent",
  "description": "Guide agent-driven parameter optimization for configurable systems with measurable objectives. Use for HPO, inference tuning, simulations, or RL/control experiments.",
  "publisher": "sickn33",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "general"
    ],
    "tags": [
      "skill-md",
      "optimization",
      "hyperparameter-optimization",
      "experiments",
      "tuning",
      "skills-sh"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Guide agent-driven parameter optimization for configurable systems with measurable objectives. Use for HPO, inference tuning, simulations, or RL/control experiments."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "skills.sh",
      "repository": "https://github.com/sickn33/agentic-awesome-skills",
      "path": "skills/optim-agent/SKILL.md",
      "ref": "HEAD",
      "url": "https://github.com/sickn33/agentic-awesome-skills/blob/HEAD/skills/optim-agent/SKILL.md",
      "key": "sickn33/agentic-awesome-skills/skills/optim-agent/SKILL.md"
    },
    "license": "MIT"
  },
  "instructions": "# Optim Agent\n\n## Overview\n\nUse this skill to optimize configurable systems against a measurable scalar objective. It helps an agent turn vague tuning requests into bounded experiments with a defined search space, budget, baseline, and evidence-backed recommendation.\n\n## When to Use This Skill\n\n- Use when tuning hyperparameters, prompts, inference settings, simulation parameters, quantitative strategies, or RL/control policies.\n- Use when the objective can be measured as a scalar score, loss, accuracy, cost, latency, reward, or risk-adjusted metric.\n- Use when the user needs a small-budget opt",
  "cost": {
    "context_tokens": 877
  }
}

Fetch it by URL: GET /api/v1/registry/sickn33-agentic-awesome-skills-optim-agent/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.