Cloudflare gives AI companies until September 15 to separate crawlers or face default block on publisher sites

Cloudflare requires AI companies to separate search crawlers from training and agent crawlers by September 15, or face default blocking on publisher sites.

It gives them a powerful tool to block training crawlers by default, strengthening their ability to demand compensation for use of their content in AI training.

The deadline is September 15, 2026, after which non-compliant AI companies will be blocked by default.