x402 Bazaar Logox402 Bazaar
← Back to discover
httppayai

Ai Crawler Policy

Paid AI training / retrieval crawler policy audit (cycle 117) — fetches /robots.txt + /llms.txt + /llms-full.txt + /meta-robots + probes 3 ai.txt paths (/.well-known/ai.txt + /.well-known/ai-crawler-policy + /ai.txt), classifies per-UA policy for 19 AI crawlers across 4 categories: training (GPTBot/ClaudeBot/Claude-Web/anthropic-ai/Google-Extended/CCBot/PerplexityBot/Bytespider/cohere-ai/Applebot-Extended/Meta-ExternalAgent/Diffbot) + retrieval...

Resource URL

https://6xrkjcfa3yrzvefcpvanurzou4.srv.us/api/ai-crawler-policy

Payment options

exactBase (8453)

$0 USDC

Max amount

Pay to
0xCa0a6c6Aa7A8F0D5893636CF166Ea2b44fb6500c
Timeout
60s

Tags

robotsapiurl-metadataauditweb

For agents

Prompt snippet for AI agents

Find and pay for this x402 resource:
URL: https://6xrkjcfa3yrzvefcpvanurzou4.srv.us/api/ai-crawler-policy
Type: http
Sources: payai

Developer