httpcdp

kairostamp.com

robots.txt check: fetches the origin's /robots.txt server-side and reports whether a given URL path is allowed or blocked for a user agent, with the matched rule, the robots URL, the HTTP status, a timestamp and a tamper-evident receipt. Query parameters: url (required), user_agent (optional, defaults to *). Only robots.txt is fetched; no crawling. Pair with GET /api/v1/link-map or /api/v1/sitemap to plan an allowed fetch.

Resource URL

https://kairostamp.com/api/v1/robots-check

Payment options

exactBase (8453)

$0.001 USDC

Max amount

Pay to: 0xdB6F694aE695C632C82677a50593B46137808453
Timeout: 300s

For agents

Prompt snippet for AI agents

Find and pay for this x402 resource:
URL: https://kairostamp.com/api/v1/robots-check
Type: http
Sources: cdp

Payment options

For agents

Developer