Hi - I answer from the OpenSmartRoute documentation: routing, the API, plans and quotas, self-hosting. Ask away, or open a support ticket if you need a person.
Grounded in the docs - follow a source before acting on it.
scraping-skills - Skill - OpenSmartRoute
Skillv1.0.0
scraping-skills
6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.
Imported from wentorai/research-plugins (skills/tools/scraping/SKILL.md). Install upstream with npx skills add wentorai/research-plugins --skill scraping. Copyright stays with the author.
Web Scraping & Data Collection — 6 Skills
Select the skill matching the user's need, then read its SKILL.md.
Scrape web data ethically and legally for research purposes
Use it
Copy one of these into your project. Installing also returns the manifest and these snippets.
# after Install: the listing is in your workspace's routing pool - a plan picks it for its slot
curl -s -X POST https://api.opensmartroute.ai/api/v1/route -H 'Authorization: Bearer $OSR_API_KEY' -H 'Content-Type: application/json' -d '{"text": "...", "plan": true}'
Installed into a catalogue, chosen by a router
Install scraping-skills and it becomes one more candidate the router can pick - when it fits.
A listing is a routing target with a manifest: what it does, which domains it covers, what it costs and who publishes it. Once installed it sits beside your own models and tools, is scored like any other candidate for each request, and shows up in the trace when it wins. Ratings come from workspaces that installed it, one per account.
An Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.
wentorai-research-plugins-scraping.ocm.jsonjson
{
"ocm": "1",
"id": "wentorai-research-plugins-scraping",
"kind": "skill",
"name": "scraping-skills",
"description": "6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.",
"publisher": "wentorai",
"version": "1.0.0",
"capabilities": {
"domains": [
"coding"
],
"tags": [
"skill-md",
"skills-sh"
],
"languages": [
"en"
]
},
"quality_prior": 0.6,
"examples": [
"6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks."
],
"primary": false,
"metadata": {
"source": {
"provider": "skills.sh",
"repository": "https://github.com/wentorai/research-plugins",
"path": "skills/tools/scraping/SKILL.md",
"ref": "HEAD",
"url": "https://github.com/wentorai/research-plugins/blob/HEAD/skills/tools/scraping/SKILL.md",
"key": "wentorai/research-plugins/skills/tools/scraping/SKILL.md"
}
},
"instructions": "# Web Scraping & Data Collection — 6 Skills\n\nSelect the skill matching the user's need, then `read` its SKILL.md.\n\n| Skill | Description |\n|-------|-------------|\n| [academic-web-scraping](./academic-web-scraping/SKILL.md) | Ethical web scraping and API-based data collection for research |\n| [dataset-finder-guide](./dataset-finder-guide/SKILL.md) | Search and download research datasets from Kaggle, HuggingFace, and repos |\n| [easy-spider-guide](./easy-spider-guide/SKILL.md) | Guide to EasySpider for visual no-code web data collection |\n| [google-scholar-scraper](./google-scholar-scraper/SKILL.",
"cost": {
"context_tokens": 236
}
}
Fetch it by URL: GET /api/v1/registry/wentorai-research-plugins-scraping/manifest?version=1.0.0
Reviews
Star ratings from people who tried it. One review per account; edit yours any time.
No reviews yet. Install it, try it, and be the first to rate it.
