← Back to discover
httpthirdwebcdp
aayatai.com
Turn a small website, or one section of it, into clean Markdown: starts from your URL, finds pages from the sitemap or by following links on the same site, obeys robots.txt, and returns up to 10 pages (title, Markdown, address) in one call. Great for docs, blogs and company sites. ?url=https://example.com/docs/&maxPages=10&path=/docs/
Resource URL
https://aayatai.com/crawl
Payment options
exactBase (8453)
$0.03 USDC
Max amount
- Pay to
- 0xbA7d7DcA32B3659DbAB451E5b408FF8F23F13442
- Timeout
- 60s
exactSolana
$0.03 USDC
Max amount
- Pay to
- Byc8ebwdxxB4u4U9xuMnH9HwwKTV4JYAFLeU1jNCCT4Q
- Timeout
- 60s
exactPolygon (137)
$0.03 USDC
Max amount
- Pay to
- 0xbA7d7DcA32B3659DbAB451E5b408FF8F23F13442
- Timeout
- 60s
exactArbitrum (42161)
$0.03 USDC
Max amount
- Pay to
- 0xbA7d7DcA32B3659DbAB451E5b408FF8F23F13442
- Timeout
- 60s
Tags
crawlscrapingmarkdownwebdocs
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://aayatai.com/crawl Type: http Sources: thirdweb, cdp