AI Crawl Control - Pay Per Crawl advanced configuration
Advanced Pay Per Crawl settings are now available, allowing you to disable charging by URI pattern, implement dynamic pricing via origin headers or Cloudflare Workers, and set prices based on request properties. A new cf-pay-per-crawl request header is added to origin requests when dynamic pricing is enabled.
You can now configure advanced Pay Per Crawl settings for your zone, including:
- Disable Pay Per Crawl by URI pattern using Configuration Rules to offer free access to specific pages while charging for others.
- Dynamic pricing by having your origin return a
crawler-priceresponse header, or by using a Cloudflare Worker to set prices based on request properties.
When dynamic pricing is enabled, Pay Per Crawl adds a cf-pay-per-crawl request header to origin requests so your origin or Worker can determine the appropriate price.
Refer to the Advanced configuration documentation for details.
Source: original entry ↗
More from Cloudflare
Follow Cloudflare to get its new changes in your feed and email digest.
Cloudflare One Client for macOS 2026.8.2100.0
GA release for macOS Cloudflare One Client with improved split tunnel handling that no longer briefly blocks traffic during reconnects, support for non-RFC 1918 local IPv4 networks, faster connects with lower memory use, and numerous reliability fixes across DNS, reauthentication, and client stability.
Cloudflare One Client for Windows 2026.8.2100.0
This GA release improves split tunnel reliability, adds support for non-RFC 1918 local networks, optimizes connection performance with faster reconnections and lower memory usage, and includes numerous bug fixes for DNS, registration, and network handling. The client now features a service recovery mechanism that automatically restarts on system unlock and better handles large hosts files without blocking traffic.
Cloudflare One Client for Linux 2026.8.2100.0
New GA release for Linux with improved split tunnel handling that no longer briefly blocks traffic during reconnects, support for non-RFC 1918 local IPv4 networks, faster tunnel reconnections, and lower memory usage. Includes numerous stability and reliability fixes for DNS, reconnection behavior, and crash issues.