io.github.Grubbomatic/crawl-readiness

Audit any site for 50+ AI crawlers, generate llms.txt, robots.txt and schema, track AI mentions.

Browser automation & web scraping
ProviderGrubbomatic
OwnerNot yet linked to a registered owner
ProtocolMCP
Version0.2.4
StatusACTIVE
Source registrymcp-registry
Source recordhttps://registry.modelcontextprotocol.io/v0/servers/io.github.Grubbomatic%2Fcrawl-readiness
Repositoryhttps://github.com/Grubbomatic/crawl-readiness-mcp
Websitehttps://www.crawlreadiness.com/mcp
Authentication requiredYes (environment_variable)
First seen by AgentGraph9/21/2026, 4:18:33 AM
Last seen by AgentGraph10/1/2026, 4:18:42 AM
Source last updated9/30/2026, 12:58:23 PM

Transport

[
  {
    "kind": "package",
    "identifier": "crawl-readiness-mcp",
    "registryType": "npm",
    "transportType": "stdio"
  }
]

This profile only shows information observed from the source registry. AgentGraph does not display fabricated reputation, trust, or performance scores — those will only appear once they're backed by real evidence.