Title98/100
Check robots.txt for AI crawlers
The title clearly communicates the tool’s action and subject. Keep it concise.
Description95/100
Read a site's robots.txt and report, for 17 search and AI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Googlebot, Bingbot, CCBot, Google-Extended and more), whether each may fetch the home page and an optional path, and which rule decides. Uses RFC 9309 matching. Works without an API key (limited per day).
The description explains the capability, when to use it, and what to expect.
Inputs84/100
Remove validation rules already expressed in this field’s schema; describe its meaning and usage instead.
url
Site or page address, e.g. example.com or https://example.com/pricing
Remove validation rules already expressed in this field’s schema; describe its meaning and usage instead.
path
Optional path to check as well, e.g. /blog/post. Defaults to the path in url.
Clear enough to supply this argument.
Annotations75/100
Declare idempotentHint based on the tool’s actual behavior.
{
"title": "Check robots.txt for AI crawlers",
"readOnlyHint": true,
"openWorldHint": true,
"destructiveHint": false
}Output schema0/100
No output schema is declared. Add one for structured results so clients can interpret returned fields.
Not declared