About

Imported from yonatangross/orchestkit (src/skills/web-research-workflow/SKILL.md). Install upstream with npx skills add yonatangross/orchestkit --skill web-research-workflow. Copyright stays with the author (MIT).

Web Research Workflow

Name: web-research-workflow
Author: yonatangross

Unified approach for web content research that automatically selects the right tool for each situation.

Quick Decision Tree

URL to research
     │
     ▼
┌─────────────────┐
│ 1. Try WebFetch │ ← Fast, free, no overhead
│    (always try) │
└─────────────────┘
     │
Content OK? ──Yes──► Parse and return
     │
     No (empty/partial/<500 chars)
     │
     ▼
┌───────────────────────┐
│ 2. TAVILY_API_KEY set?│
└───────────────────────┘
     │          │
    Yes         No ──► Skip to step 3
     │
     ▼
┌───────────────────────────┐
│ Tavily search/extract/    │ ← Raw markdown, batch URLs
│ crawl/research            │
└───────────────────────────┘
     │
Content OK? ──Yes──► Parse and return
     │
     No (JS-rendered/auth-required)
     │
     ▼
┌─────────────────────┐
│ 3. Use agent-browser │ ← Full browser, last resort
└─────────────────────┘
     │
├─ SPA (react/vue/angular) ──► wait --load networkidle
├─ Login required ──► auth flow + state save
├─ Dynamic content ──► wait --text "Expected"
└─ Multi-page ──► crawl pattern

Tavily Enhanced Research

When TAVILY_API_KEY is set, Tavily provides a powerful middle tier between WebFetch and agent-browser. It returns raw markdown content, supports batch URL extraction, and offers semantic search with relevance scoring. If TAVILY_API_KEY is not set, the 3-tier tree collapses to 2-tier (WebFetch → agent-browser) automatically.

Load details: Read("rules/tool-selection.md") for when-to-use-what tables, escalation heuristics, SPA detection patterns, and cost awareness.

Load details: Read("references/tavily-api.md") for Search, Extract, Map, Crawl, and Research endpoint examples and options.

Browser Patterns

For content requiring JavaScript rendering, authentication, or multi-page crawling, fall back to agent-browser.

Load details: Read("rules/browser-patterns.md") for auto-fallback, authentication flow, multi-page research patterns, best practices, and troubleshooting.

Competitive Monitoring

Track competitor websites for changes in pricing, features, positioning, and content.

Load details: Read("rules/monitoring-competitor.md") for snapshot capture, structured data extraction, and change classification.

Load details: Read("rules/monitoring-change-detection.md") for diff detection, structured comparison, Tavily site discovery, and CI automation.

Change Classification

Severity	Examples	Action
Critical	Price increase/decrease, major feature change	Immediate alert
High	New feature added, feature removed	Review required
Medium	Copy changes, positioning shift	Note for analysis
Low	Typos, minor styling	Log only

Integration with Agents

This skill is used by:

web-research-analyst - Primary user
market-intelligence - Competitor research
product-strategist - Deep competitive analysis

Related Skills

browser-content-capture - Detailed browser patterns
agent-browser - CLI reference

Version: 1.3.0 (March 2026)

Use it

Copy one of these into your project. Installing also returns the manifest and these snippets.

yaml

targets:
  - https://api.opensmartroute.ai/api/v1/registry/yonatangross-orchestkit-web-research-workflow/manifest   # or paste the manifest below

Manifest

An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.

yonatangross-orchestkit-web-research-workflow.ocm.jsonjson

{
  "ocm": "1",
  "id": "yonatangross-orchestkit-web-research-workflow",
  "kind": "skill",
  "name": "web-research-workflow",
  "description": "Unified decision tree for web research and competitive monitoring. Auto-selects WebFetch, Tavily, or agent-browser based on target site characteristics and available API keys. Includes competitor page tracking, snapshot diffing, and change alerting. Use when researching web content, scraping, extracting raw markdown, capturing documentation, or monitoring competitor changes.",
  "publisher": "yonatangross",
  "version": "1.0.0",
  "capabilities": {
    "domains": [
      "coding"
    ],
    "tags": [
      "skill-md",
      "research",
      "browser",
      "webfetch",
      "tavily",
      "automation",
      "scraping",
      "content-extraction",
      "competitive-intelligence",
      "monitoring"
    ],
    "languages": [
      "en"
    ]
  },
  "quality_prior": 0.6,
  "examples": [
    "Unified decision tree for web research and competitive monitoring. Auto-selects WebFetch, Tavily, or agent-browser based on target site characteristics and available API keys. Includes competitor page tracking, snapshot diffing, and change alerting. Use when researching web content, scraping, extracting raw markdown, capturing documentation, or monitoring competitor changes."
  ],
  "primary": false,
  "metadata": {
    "source": {
      "provider": "skills.sh",
      "repository": "https://github.com/yonatangross/orchestkit",
      "path": "src/skills/web-research-workflow/SKILL.md",
      "ref": "HEAD",
      "url": "https://github.com/yonatangross/orchestkit/blob/HEAD/src/skills/web-research-workflow/SKILL.md",
      "key": "yonatangross/orchestkit/src/skills/web-research-workflow/SKILL.md"
    },
    "compatibility": "Claude Code 2.1.251+. Requires network access.",
    "allowed_tools": [
      "Bash",
      "Read",
      "Write",
      "WebFetch"
    ],
    "license": "MIT"
  },
  "instructions": "# Web Research Workflow\n\nUnified approach for web content research that automatically selects the right tool for each situation.\n\n## Quick Decision Tree\n\n```\nURL to research\n     │\n     ▼\n┌─────────────────┐\n│ 1. Try WebFetch │ ← Fast, free, no overhead\n│    (always try) │\n└─────────────────┘\n     │\nContent OK? ──Yes──► Parse and return\n     │\n     No (empty/partial/<500 chars)\n     │\n     ▼\n┌───────────────────────┐\n│ 2. TAVILY_API_KEY set?│\n└───────────────────────┘\n     │          │\n    Yes         No ──► Skip to step 3\n     │\n     ▼\n┌───────────────────────────┐\n│ Tavily search/extract/   ",
  "cost": {
    "context_tokens": 770
  }
}

Fetch it by URL: GET /api/v1/registry/yonatangross-orchestkit-web-research-workflow/manifest?version=1.0.0

Reviews

Star ratings from people who tried it. One review per account; edit yours any time.

No reviews yet. Install it, try it, and be the first to rate it.