botbase-9d90d5df·1 events·first seen Aliases: BotBase
Cloudflare announced new AI traffic controls that block training and agent bots by default while allowing search indexing crawlers, effective September 15, 2026. Publishers can toggle access granularly by bot use case, and multi-purpose crawlers (e.g., Googlebot, Bingbot) are subject to the most restrictive setting applied. Cloudflare also introduced BotBase, a public bot classification database, and a forthcoming per-request monetization tool allowing publishers to charge AI agents for web access. The move affects nearly 20% of the internet and raises the cost of web data acquisition for AI training, with disproportionate impact on smaller AI developers.