An experiment in which Googlebot needed 9x more time to crawl JS pages than HTML pages demonstrates the existence of a rendering queue at Google.

mrtillman

Community Picks is a section on daily.dev where our community members share the most interesting and valuable content they've discovered online. From insightful articles to handy tools, every post is a gem curated by our dedicated coomunity. To contribute to Community Picks, you need to have at least 250 reputation points, ensuring that only active and trusted members can share their finds.

Community Picks

Googlebot could only access a given page by following a JavaScript-injected internal link. With HTML, it took just 36 hours to crawl the - third page was crawled after waiting in the crawl queue for 164 hours. At the same time, the third page in the /html/ folder got crawled three hours after the second page was discovered.

Google Needs 9X More Time To Crawl JS Than HTML