← Back to discover
httppayai
LLM Crawl Policy
Paid AI/LLM crawl-policy synthesis (x402 $0.001) - GET ?domain=<DOMAIN> reads robots.txt, llms.txt, agents.txt and ai.txt, resolves policy for 40+ AI-bot User-Agents, and returns allow/block counts plus an A-F llm_crawl_score. via x402
Resource URL
https://6xrkjcfa3yrzvefcpvanurzou4.srv.us/api/llm-crawl-policy
Payment options
exactBase (8453)
$0 USDC
Max amount
- Pay to
- 0xCa0a6c6Aa7A8F0D5893636CF166Ea2b44fb6500c
- Timeout
- 60s
Tags
robotssitemapapidnsx402
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://6xrkjcfa3yrzvefcpvanurzou4.srv.us/api/llm-crawl-policy Type: http Sources: payai