robots-txt-checker

远程

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

⭐ 0其他

安装配置

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp"
    }
  }
}