← Back to discover
httpthirdwebcdp
agentsvc.io
List the URLs of a website without reading them: robots.txt, sitemaps and sitemap indexes plus homepage links, up to 1,000 same-site URLs with lastmod and source. A cheap first step to decide which pages to read with web-read-batch or site-crawl. Returns no page content. Params: url (site or domain, required), max_urls (1 to 1000, default 200).
Resource URL
https://agentsvc.io/api/v1/proxy/site-map
Payment options
exactBase (8453)
$0.008 USDC
Max amount
- Pay to
- 0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27
- Timeout
- 300s
exactSolana
$0.008 USDC
Max amount
- Pay to
- 5JzPS5qpEwUM1vTC9GG7uqvwJdHzbEwfoPHf2Ki977tg
- Timeout
- 300s
exactPolygon (137)
$0.008 USDC
Max amount
- Pay to
- 0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27
- Timeout
- 300s
exactArbitrum (42161)
$0.008 USDC
Max amount
- Pay to
- 0x622efA6Ceb83a5b6EdBC931332f4db68B7f74F27
- Timeout
- 300s
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://agentsvc.io/api/v1/proxy/site-map Type: http Sources: thirdweb, cdp