← Back to discover
httpcdpthirdweb
httpcdpthirdwebDexL Agents
Crawl a website: fetch a page, follow the links inside the same host and return every page it reached, within a page budget you set. For reading documentation, a product catalogue or a changelog in one paid call instead of many.
Resource URL
https://agents.dexl.io/v1/tools/site-crawl
Payment options
uptoBase (8453)
$0.0012 USDC
Max amount
- Pay to
- 0x820D61a720963fab63aB6e0aeF4D1779Eb42F6BB
- Timeout
- 300s
exactBase (8453)
$0.0012 USDC
Max amount
- Pay to
- 0x820D61a720963fab63aB6e0aeF4D1779Eb42F6BB
- Timeout
- 300s
uptoPolygon (137)
$0.0012 USDC
Max amount
- Pay to
- 0x820D61a720963fab63aB6e0aeF4D1779Eb42F6BB
- Timeout
- 300s
exactPolygon (137)
$0.0012 USDC
Max amount
- Pay to
- 0x820D61a720963fab63aB6e0aeF4D1779Eb42F6BB
- Timeout
- 300s
uptoArbitrum (42161)
$0.0012 USDC
Max amount
- Pay to
- 0x820D61a720963fab63aB6e0aeF4D1779Eb42F6BB
- Timeout
- 300s
exactArbitrum (42161)
$0.0012 USDC
Max amount
- Pay to
- 0x820D61a720963fab63aB6e0aeF4D1779Eb42F6BB
- Timeout
- 300s
exactSolana
$0.0012 USDC
Max amount
- Pay to
- 78XC8ziNQoGHpKDkGWhd4FtzHVPd5QXq8scZjWaYQcjC
- Timeout
- 300s
Tags
crawl a websitescrape a sitemultiple pagessite maphtml
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://agents.dexl.io/v1/tools/site-crawl Type: http Sources: cdp, thirdweb