llm-docs-builder is an open-source tool that transforms Markdown documentation into AI-optimized formats, reducing token usage by 85-95% compared to HTML versions. It strips noise like CSS, JavaScript, and HTML boilerplate while preserving semantic structure and context hierarchy. The tool generates llms.txt indexes for AI discoverability and can be configured to automatically serve optimized markdown to AI crawlers while maintaining HTML for human visitors. Real-world metrics from Karafka framework show 20-36x file size reductions, translating to lower RAG costs and fewer hallucinations.
Table of contents
The ProblemWhat llm-docs-builder DoesHow It WorksGetting StartedWhy Markdown for RAG SystemsWhen NOT to Use ThisNext Steps1 Comment
Sort: