← Back to discover
httpthirdwebpayaicdp
httpthirdwebpayaicdpapi.crawlwitness.com
Use when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) from robots.txt, IETF AIPREF, TDMRep, noai and RSL licenses, with a signed receipt. Errors: 400 invalid domain or unknown bot (not charged).
Resource URL
https://api.crawlwitness.com/v1/can-use
Payment options
exactBase (8453)
$0.001 USDC
Max amount
- Pay to
- 0xa20F0b8ADf20Ed17a8d27B369B3058afdB71a5C5
- Timeout
- 300s
exactSolana
$0.002 USDC
Max amount
- Pay to
- DEuats4W5mXoX1dZEb693q4Y4GT6mnZiwPjTN2GYFFrd
- Timeout
- 300s
Tags
ai-consentrobots-txtcrawler-compliancedata-licensingbatch
For agents
Prompt snippet for AI agents
Find and pay for this x402 resource: URL: https://api.crawlwitness.com/v1/can-use Type: http Sources: thirdweb, payai, cdp