Skip to content
Skillv1.0.0

quality-metrics

Tracks quality metrics including defect density, test effectiveness ratio, DORA metrics, and mean time to detection. Use when establishing quality dashboards, defining KPIs, evaluating test suite effe

by proffesor-for-testing(0) 0 installs
Free
Sign in to install

Free account. Installing gives you the manifest plus copy-paste snippets.

See reviews

About

Imported from proffesor-for-testing/agentic-qe (.claude/skills/quality-metrics/SKILL.md). Install upstream with npx skills add proffesor-for-testing/agentic-qe --skill quality-metrics. Copyright stays with the author.

Quality Metrics

<default_to_action> When measuring quality or building dashboards:

  1. MEASURE outcomes (bug escape rate, MTTD) not activities (test count)
  2. AVOID vanity metrics: 100% coverage means nothing if tests don't catch bugs
  3. SET thresholds that drive behavior (quality gates block bad code)
  4. TREND over time: Direction matters more than absolute numbers </default_to_action>

Quick Reference Card

When to Use

  • Building quality dashboards
  • Defining quality gates
  • Evaluating testing effectiveness
  • Justifying quality investments

Quality Gate Thresholds

Metric Blocking Threshold Warning
Test pass rate 100% -
Critical coverage > 80% > 70%
Security critical 0 -
Performance p95 < 200ms < 500ms
Flaky tests < 2% < 5%

Dashboard Design

// Agent generates quality dashboard
await Task("Generate Dashboard", {
  metrics: {
    delivery: ['deployment-frequency', 'lead-time', 'change-failure-rate'],
    quality: ['bug-escape-rate', 'test-effectiveness', 'defect-density'],
    stability: ['mttd', 'mttr', 'availability'],
    process: ['code-review-time', 'flaky-test-rate', 'coverage-trend']
  },
  visualization: 'grafana',
  alerts: {
    critical: { bug_escape_rate: '>20%', mttr: '>24h' },
    warning: { coverage: '<70%', flaky_rate: '>5%' }
  }
}, "qe-quality-analyzer");

Quality Gate Configuration

{
  "qualityGates": {
    "commit": {
      "coverage": { "min": 80, "blocking": true },
      "lint": { "errors": 0, "blocking": true }
    },
    "pr": {
      "tests": { "pass": "100%", "blocking": true },
      "security": { "critical": 0, "blocking": true },
      "coverage_delta": { "min": 0, "blocking": false }
    },
    "release": {
      "e2e": { "pass": "100%", "blocking": true },
      "performance_p95": { "max_ms": 200, "blocking": true },
      "bug_escape_rate": { "max": "10%", "blocking": false }
    }
  }
}

Agent-Assisted Metrics

// Calculate quality trends
await Task("Quality Trend Analysis", {
  timeframe: '90d',
  metrics: ['bug-escape-rate', 'mttd', 'test-effectiveness'],
  compare: 'previous-90d',
  predictNext: '30d'
}, "qe-quality-analyzer");

// Evaluate quality gate
await Task("Quality Gate Evaluation", {
  buildId: 'build-123',
  environment: 'staging',
  metrics: currentMetrics,
  policy: qualityPolicy
}, "qe-quality-gate");

Agent Coordination Hints

Memory Namespace

aqe/quality-metrics/
├── dashboards/*         - Dashboard configurations
├── trends/*             - Historical metric data
├── gates/*              - Gate evaluation results
└── alerts/*             - Triggered alerts

Fleet Coordination

const metricsFleet = await FleetManager.coordinate({
  strategy: 'quality-metrics',
  agents: [
    'qe-quality-analyzer',         // Trend analysis
    'qe-test-executor',            // Test metrics
    'qe-coverage-analyzer',        // Coverage data
    'qe-production-intelligence',  // Production metrics
    'qe-quality-gate'              // Gate decisions
  ],
  topology: 'mesh'
});

Related Skills


Remember

With Agents: Agents track metrics automatically, analyze trends, trigger alerts, and make gate decisions. Use agents to maintain continuous quality visibility.

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml
targets:
  - https://api.opensmartroute.ai/api/v1/registry/proffesor-for-testing-agentic-qe-quality-metrics/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

proffesor-for-testing-agentic-qe-quality-metrics.ocm.jsonjson
{
  "ocm": "1",
  "id": "proffesor-for-testing-agentic-qe-quality-metrics",
  "kind": "skill",
  "name": "quality-metrics",
  "description": "Tracks quality metrics including defect density, test effectiveness ratio, DORA metrics, and mean time to detection. Use when establishing quality dashboards, defining KPIs, evaluating test suite effectiveness, or reporting quality trends to stakeholders.",
  "publisher": "proffesor-for-testing",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "general"
    ],
    "tags": [
      "skill-md",
      "metrics",
      "dora",
      "quality-gates",
      "dashboards",
      "kpis",
      "measurement",
      "skills-sh"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Tracks quality metrics including defect density, test effectiveness ratio, DORA metrics, and mean time to detection. Use when establishing quality dashboards, defining KPIs, evaluating test suite effectiveness, or reporting quality trends to stakeholders."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "skills.sh",
      "repository": "https://github.com/proffesor-for-testing/agentic-qe",
      "path": ".claude/skills/quality-metrics/SKILL.md",
      "ref": "HEAD",
      "url": "https://github.com/proffesor-for-testing/agentic-qe/blob/HEAD/.claude/skills/quality-metrics/SKILL.md",
      "key": "proffesor-for-testing/agentic-qe/.claude/skills/quality-metrics/SKILL.md"
    }
  },
  "instructions": "# Quality Metrics\n\n<default_to_action>\nWhen measuring quality or building dashboards:\n1. MEASURE outcomes (bug escape rate, MTTD) not activities (test count)\n2. AVOID vanity metrics: 100% coverage means nothing if tests don't catch bugs\n3. SET thresholds that drive behavior (quality gates block bad code)\n4. TREND over time: Direction matters more than absolute numbers\n</default_to_action>\n\n## Quick Reference Card\n\n### When to Use\n- Building quality dashboards\n- Defining quality gates\n- Evaluating testing effectiveness\n- Justifying quality investments\n\n### Quality Gate Thresholds\n| Metric | Blo",
  "cost": {
    "context_tokens": 924
  }
}

Fetch it by URL: GET /api/v1/registry/proffesor-for-testing-agentic-qe-quality-metrics/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.