x402 Bazaar Logox402 Bazaar
← Back to discover
httpagent-toolscdpultravioletadaothirdweb

minifetch.com

Cheap robots.txt preflight check before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether Minifetch may fetch a target URL (allow/deny) plus its crawl-delay. If blocked and the site is not yours try our external proxy routes. If blocked and the site is yours or to set a custom crawl-delay read https://minifetch.com/tutorials/unblock-minifetch Checks the URL as given — does not follow redirects. Supports GET & POST

Resource URL

https://minifetch.com/api/v1/x402/preflight/url-check

Payment options

exactBase (8453)

$0.001 USDC

Max amount

Pay to
0xffA9155A0e4B3d8d42351Da226cC1feEe449686f
Timeout
300s
exactSolana

$0.001 USDC

Max amount

Pay to
46vMcwuC4sK11sB3gkLhyA7J7GEwfkhn5rFyDtihBwqe
Timeout
300s

Tags

UtilitySearchhealth:okseorobots-txtpreflightcrawlabilityindexability

For agents

Prompt snippet for AI agents

Find and pay for this x402 resource:
URL: https://minifetch.com/api/v1/x402/preflight/url-check
Type: http
Sources: agent-tools, cdp, ultravioletadao, thirdweb

Developer