Robots No Open Directory Project
Download List of All Websites using Robots No Open Directory Project
These are used if your website is listed in this directorie with information you do not want used in the results pages. This might be the case if you have old, outdated listings that no longer apply. They tell robots not to use information from these sources, and they are optional.
Must Revalidate HTTP Cache-Control
Download List of All Websites using Must Revalidate HTTP Cache-Control
Indicates that once a resource has become stale (e.g. max-age has expired), a cache must not use the response to satisfy subsequent requests for this resource without successful validation on the origin server.
Tags:
NO Store HTTP Cache-Control
Download List of All Websites using NO Store HTTP Cache-Control
The cache should not store anything about the client request or server response.
Tags:
No Cache Content
Download List of All Websites using No Cache Content
Forces caches to submit the request to the origin server for validation before releasing a cached copy.
Tags:
Pragma Header - backwards compatibility with HTTP/1.0
Download List of All Websites using Pragma Header - backwards compatibility with HTTP/1.0
The Pragma HTTP/1.0 general header is an implementation-specific header that may have various effects along the request-response chain. It is used for backwards compatibility with HTTP/1.0 caches where the Cache-Control HTTP/1.1 header is not yet present.
Tags:
Vary Header check for User-Agent
Download List of All Websites using Vary Header check for User-Agent
When using the Vary: User-Agent header, caching servers should consider the user agent when deciding whether to serve the page from cache
Tags:
Vary Header Accept-Encoding
Download List of All Websites using Vary Header Accept-Encoding
The Accept-Encoding request HTTP header advertises which content encoding, usually a compression algorithm, the client is able to understand. Using content negotiation, the server selects one of the proposals, uses it and informs the client of its choice with the Content-Encoding response header.
Tags:
XFN 1.1
Download List of All Websites using XFN 1.1
XFN is a technical term that is an acronym that stands for “XHTML Friends Network.” This is primarily used by websites that want to create a series of referral links between other websites in order to boost SEO ratings.