Cloudflare now supports Markdown for AI agents. Explore why "Intent Engineering" and transparent web design are the future for both humans and bots alike.

The New Stack is a publication covering trends and technologies in cloud-native development, DevOps, and software delivery. Developers can learn about containerization, Kubernetes, and cloud computing, as well as explore topics such as microservices architecture, serverless computing, and continuous integration/continuous delivery (CI/CD) pipelines.

The New Stack

Cloudflare now supports real-time Markdown conversion for AI agents, stripping HTML noise to reduce LLM context window usage. The author uses this as a springboard to argue that designing websites purely for agent extraction misses the point. Rather than treating AI agents as simple data scrapers, the concept of 'intent engineering' suggests giving agents meaningful objectives and letting them navigate the web more holistically. The post also touches on progressive enhancement, Schema.org microdata, and transparent URL structures as ways to make sites friendlier for both humans and bots without sacrificing one for the other.

Cloudflare’s new Markdown support shows how the web is evolving for AI agents

Your site can be nicer to agents and humans, too