polite-crawler
A polite crawler for agents: obeys robots.txt, fetches each page once, finds and verifies quotes.
Browser automation & web scraping
| Provider | mark1russell7 |
|---|---|
| Owner | Not yet linked to a registered owner |
| Protocol | MCP |
| Version | 0.3.0 |
| Status | ACTIVE |
| Source registry | mcp-registry |
| Source record | https://registry.modelcontextprotocol.io/v0/servers/io.github.mark1russell7%2Fpolite-crawler |
| Repository | https://github.com/mark1russell7/crawler |
| Website | https://mark1russell7.github.io/crawler/ |
| Authentication required | No |
| First seen by AgentGraph | 10/26/2026, 4:18:33 AM |
| Last seen by AgentGraph | 11/4/2026, 4:18:26 AM |
| Source last updated | 11/2/2026, 8:02:25 PM |
Transport
[
{
"kind": "package",
"identifier": "polite-crawler-mcp",
"runtimeHint": "npx",
"registryType": "npm",
"transportType": "stdio"
}
]This profile only shows information observed from the source registry. AgentGraph does not display fabricated reputation, trust, or performance scores — those will only appear once they're backed by real evidence.