SEO Robots : Allow to index and follow website links
Download List of All Websites using SEO Robots : Allow to index and follow website links
Meta robots tag is a tag that tells search engines what to follow and what not to follow.
Vary Header check for User-Agent
Download List of All Websites using Vary Header check for User-Agent
When using the Vary: User-Agent header, caching servers should consider the user agent when deciding whether to serve the page from cache
Tags:
HTTP Upgrade Header - HTTP/2
Download List of All Websites using HTTP Upgrade Header - HTTP/2
The HTTP Upgrade mechanism is used to establish HTTP/2 starting from plain HTTP. The client starts an HTTP/1.1 connection and sends an Upgrade: h2c header. If the server supports HTTP/2, it replies with HTTP 101 Switching Protocol status code. The HTTP Upgrade mechanism is used only for cleartext HTTP2 (h2c). In the case of HTTP2 over TLS (h2), the ALPN TLS protocol extension is used instead.
Tags:
schema.org micro-markup
Download List of All Websites using schema.org micro-markup
Schema.org is a collaborative, community activity with a mission to create, maintain, and promote schemas for structured data on the Internet, on web pages, in email messages, and beyond.
Tags:
Google Direct link
Download List of All Websites using Google Direct link
this website is linking to google in its page.
Private Cache-Control Header
Download List of All Websites using Private Cache-Control Header
The Cache-Control general-header field is used to specify directives for caching mechanisms in both requests and responses. Caching directives are unidirectional, meaning that a given directive in a request is not implying that the same directive is to be given in the response.
Tags:
Must Revalidate HTTP Cache-Control
Download List of All Websites using Must Revalidate HTTP Cache-Control
Indicates that once a resource has become stale (e.g. max-age has expired), a cache must not use the response to satisfy subsequent requests for this resource without successful validation on the origin server.
Tags:
No Cache Content
Download List of All Websites using No Cache Content
Forces caches to submit the request to the origin server for validation before releasing a cached copy.
Tags:
XFN 1.1
Download List of All Websites using XFN 1.1
XFN is a technical term that is an acronym that stands for “XHTML Friends Network.” This is primarily used by websites that want to create a series of referral links between other websites in order to boost SEO ratings.