×
Thursday, May 9, 2024

Google Says Cache-Control Headers Aren't Used For Crawling & Indexing Unless It's Embedded Content - Search Engine Roundtable

Last updated Tuesday, December 27, 2022 08:05 ET , Source: NewsService

In 2018, John Mueller of Google said Google does not use cache-control headers when crawling. He said then that the has no impact on GoogleBot and how it crawls your web pages. He said that again today, at the end of 2022, but added, "at most, they might be used in rendering for embedded content."

John wrote on Mastodon, "Cache control headers don't apply to Google's crawling & indexing, they're for browsers." But then he added that "at most, they might be used in rendering for embedded content."

The Cache-Control HTTP header field holds directives, in both requests and responses, that control caching in browsers and shared caches (e.g. Proxies, CDNs). It is an HTTP header used to specify browser caching policies in both client requests and server responses.

Forum discussion at Mastodon.



Read Full Story: https://news.google.com/__i/rss/rd/articles/CBMiRGh0dHBzOi8vd3d3LnNlcm91bmR0YWJsZS5jb20vZ29vZ2xlLWNhY2hlLWNvbnRyb2wtaGVhZGVycy0zNDYzOS5odG1s0gFIaHR0cHM6Ly93d3cuc2Vyb3VuZHRhYmxlLmNvbS9hbXAvZ29vZ2xlLWNhY2hlLWNvbnRyb2wtaGVhZGVycy0zNDYzOS5odG1s?oc=5

Your content is great. However, if any of the content contained herein violates any rights of yours, including those of copyright, please contact us immediately by e-mail at media[@]kissrpr.com.