SEO Robots : Allow to index and follow website links
Download List of All Websites using SEO Robots : Allow to index and follow website links
Meta robots tag is a tag that tells search engines what to follow and what not to follow.
Vary Header check for User-Agent
Download List of All Websites using Vary Header check for User-Agent
When using the Vary: User-Agent header, caching servers should consider the user agent when deciding whether to serve the page from cache
Tags:
schema.org micro-markup
Download List of All Websites using schema.org micro-markup
Schema.org is a collaborative, community activity with a mission to create, maintain, and promote schemas for structured data on the Internet, on web pages, in email messages, and beyond.
Tags:
Private Cache-Control Header
Download List of All Websites using Private Cache-Control Header
The Cache-Control general-header field is used to specify directives for caching mechanisms in both requests and responses. Caching directives are unidirectional, meaning that a given directive in a request is not implying that the same directive is to be given in the response.
Tags:
Must Revalidate HTTP Cache-Control
Download List of All Websites using Must Revalidate HTTP Cache-Control
Indicates that once a resource has become stale (e.g. max-age has expired), a cache must not use the response to satisfy subsequent requests for this resource without successful validation on the origin server.
Tags:
XFN 1.1
Download List of All Websites using XFN 1.1
XFN is a technical term that is an acronym that stands for “XHTML Friends Network.” This is primarily used by websites that want to create a series of referral links between other websites in order to boost SEO ratings.
No Cache Content
Download List of All Websites using No Cache Content
Forces caches to submit the request to the origin server for validation before releasing a cached copy.
Tags: