httppayai

reader-testnet.scrapemole.workers.dev

Use when you need the list of pages a site publishes (to crawl it, find recent posts, or audit SEO): give a site URL (the sitemap is discovered from robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml) or a sitemap URL directly. Returns the page URLs with lastmod, changefreq and priority; for a sitemap index, returns its child sitemaps and (expand=true, default) the URLs of the first child sitemaps up to the limit. Gzipped sitemaps supported.

Resource URL

https://reader-testnet.scrapemole.workers.dev/v1/sitemap

Payment options

exactEVM 84532

$0.002 USDC

Max amount

Pay to: 0x45f709d6cA15Cb101Aa1989A70C0534A604a9383
Timeout: 300s

For agents

Prompt snippet for AI agents

Find and pay for this x402 resource:
URL: https://reader-testnet.scrapemole.workers.dev/v1/sitemap
Type: http
Sources: payai

Payment options

For agents

Developer