← Back to discover
httpagent-toolscdpultravioletadaothirdweb
Minifetch Technical SEO API
Cheap robots.txt preflight before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether the Minifetch user agent may fetch a target URL (allow/deny) plus its crawl-delay. If blocked or setting a crawl delay read https://minifetch.com/tutorials/unblock-minifetch . Checks the URL as given — does not follow redirects. Supports GET & POST
Resource URL
https://minifetch.com/api/v1/x402/preflight/url-check
Payment options
exactBase (8453)
$0.001 USDC
Max amount
- Pay to
- 0xffA9155A0e4B3d8d42351Da226cC1feEe449686f
- Timeout
- 300s
exactSolana
$0.001 USDC
Max amount
- Pay to
- 46vMcwuC4sK11sB3gkLhyA7J7GEwfkhn5rFyDtihBwqe
- Timeout
- 300s
Tags
UtilitySearchhealth:okseorobots-txtpreflightcrawlabilityindexability
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://minifetch.com/api/v1/x402/preflight/url-check Type: http Sources: agent-tools, cdp, ultravioletadao, thirdweb