← Back to discover
httppayai
Agent Extraction API
Sitemap to URL list: give a sitemap URL or just a domain (sitemaps found via robots.txt, then /sitemap.xml). Follows sitemap indexes (newest first, up to 10 child sitemaps), reads .xml, .xml.gz and text sitemaps, and returns every URL with lastmod, changefreq, priority, hreflang alternates, image and news counts. Filter by contains= and since= (lastmod).
Resource URL
https://freetier-agent-api.pages.dev/api/sitemap
Payment options
exactBase (8453)
$0.003 USDC
Max amount
- Pay to
- 0x165Eb3dC3E98403ecB1141e90400F5e71806554B
- Timeout
- 300s
Tags
sitemapseocrawlingurl-discoveryweb
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://freetier-agent-api.pages.dev/api/sitemap Type: http Sources: payai