How Cloudflare uses generative AI to slow down, confuse, and waste the resources of AI Crawlers and other bots that don’t respect “no crawl” directives.

Cloudflare's platform is a leading provider of internet security and performance solutions, offering insights into web security, content delivery, and DNS management. Through documentation, blog posts, and webinars, Cloudflare provides insights into protecting websites and applications from cyber threats and improving performance. Developers and IT professionals can learn about CDN (Content Delivery Network), DDoS mitigation, and firewall configurations to secure and accelerate web traffic.

Cloudflare

Cloudflare has introduced AI Labyrinth, a solution using AI-generated content to mislead and waste the resources of unauthorized AI crawlers. By deploying convincing but irrelevant AI-generated pages, AI Labyrinth identifies and distracts bots while preserving site performance and user experience. This feature is available to all Cloudflare customers and integrates seamlessly without the need for manual configuration.

Trapping misbehaving bots in an AI Labyrinth

Using Generative AI as a defensive weapon

How to use AI Labyrinth to stop AI crawlers