x402 Bazaar Logox402 Bazaar
← Back to discover
httpcdpthirdwebultravioletadao

web.openverbs.com

Discover a site's XML sitemaps (via robots.txt Sitemap: directives, an explicit sitemap URL, or the conventional /sitemap.xml) and parse them into a bounded list of URLs with their lastmod, changefreq and priority. Follows sitemap-index files to their child sitemaps. Fetches and URL counts are capped (with a `truncated` flag) to stay fast and memory-bounded. The reliable way for an agent to enumerate a site's pages.

Resource URL

https://web.openverbs.com/v1/sitemap

Payment options

exactBase (8453)

$0.006 USDC

Max amount

Pay to
0xb3f4de103F34b99f0Da19B4F16D6B53a14C2194A
Timeout
300s

Tags

parse sitemapdiscover sitemap urlsrobots sitemap lookupwebsite page enumerationsitemap xml parser

For agents

Prompt snippet for AI agents

Find and pay for this x402 resource:
URL: https://web.openverbs.com/v1/sitemap
Type: http
Sources: cdp, thirdweb, ultravioletadao

Developer