Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
Free account. Installing gives you the manifest plus copy-paste snippets.
See reviewsImported from the official MCP registry - entry
io.github.ryuamarines/robots-txt-checkerv1.0.93057. Ratings and installs below are from this marketplace.
Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).
Registry entry: io.github.ryuamarines/robots-txt-checker
Copy one of these into your project. Installing also returns the manifest and these snippets.
targets:
- https://api.opensmartroute.ai/api/v1/registry/mcp-io-github-ryuamarines-robots-txt-checker/manifest # or paste the manifest belowAn Open Capability Manifest: the router reads it to know what this does, what it costs and when to pick it.
{
"ocm": "1",
"id": "mcp-io-github-ryuamarines-robots-txt-checker",
"kind": "tool",
"name": "robots-txt-checker",
"description": "Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).",
"publisher": "io.github.ryuamarines",
"version": "1.0.93057",
"capabilities": {
"domains": [
"general"
],
"tags": [
"mcp",
"mcp-server",
"mcp-registry"
],
"languages": [
"en"
],
"supports_tools": true
},
"quality_prior": 0.6,
"examples": [
"Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC)."
],
"primary": false,
"metadata": {
"source": {
"provider": "mcp-registry",
"path": "server.json",
"ref": "1.0.93057",
"url": "https://registry.modelcontextprotocol.io/v0/servers/io.github.ryuamarines%2Frobots-txt-checker",
"key": "io.github.ryuamarines/robots-txt-checker",
"registry": "https://registry.modelcontextprotocol.io"
}
},
"endpoints": [
{
"protocol": "mcp",
"url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
}
]
}Fetch it by URL: GET /api/v1/registry/mcp-io-github-ryuamarines-robots-txt-checker/manifest?version=1.0.93057
Star ratings from people who tried it. One review per account; edit yours any time.
No reviews yet. Install it, try it, and be the first to rate it.