httppayai

reader.scrapemole.workers.dev

Use when you need the list of pages a site publishes (to crawl it, find recent posts, or audit SEO): give a site URL (the sitemap is discovered from robots.txt Sitemap: lines, then /sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml) or a sitemap URL directly. Returns the page URLs with lastmod, changefreq and priority; for a sitemap index, returns its child sitemaps and (expand=true, default) the URLs of the first child sitemaps up to the limit. Gzipped sitemaps supported.

Resource URL

https://reader.scrapemole.workers.dev/v1/sitemap

Payment options

exactBase (8453)

$0.002 USDC

Max amount

Pay to: 0xCb535d13C7fC5Fe6C2B88da3f3601B840CCaf8Bc
Timeout: 300s

For agents

Prompt snippet for AI agents

Find and pay for this x402 resource:
URL: https://reader.scrapemole.workers.dev/v1/sitemap
Type: http
Sources: payai

Payment options

For agents

Developer