← Back to discover
httpcdpultravioletadaothirdweb
toolvend.dev
Fetch and parse robots.txt (+ llms.txt if present) into structured JSON, including which AI crawlers are blocked.
Resource URL
https://toolvend.dev/parse/robots
Payment options
exactSolana
$0.005 USDC
Max amount
- Pay to
- FSnwAPTNNSxqnR8MtuNrtwLkyYusZ4hncp684HxYpdLb
- Timeout
- 120s
exactBase (8453)
$0.005 USDC
Max amount
- Pay to
- 0x55ae5d177cdc9493391a632794fd048e8dba4e20
- Timeout
- 120s
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://toolvend.dev/parse/robots Type: http Sources: cdp, ultravioletadao, thirdweb