SEO Robots : Allow to index and follow website links
Download List of All Websites using SEO Robots : Allow to index and follow website links
Meta robots tag is a tag that tells search engines what to follow and what not to follow.
X-Frame-Options Header
Download List of All Websites using X-Frame-Options Header
The X-Frame-Options HTTP response header can be used to indicate whether or not a browser should be allowed to render a page in a <frame>, <iframe>, <embed> or <object>. Sites can use this to avoid clickjacking attacks, by ensuring that their content is not embedded into other sites.
HTTP Upgrade Header - HTTP/2
Download List of All Websites using HTTP Upgrade Header - HTTP/2
The HTTP Upgrade mechanism is used to establish HTTP/2 starting from plain HTTP. The client starts an HTTP/1.1 connection and sends an Upgrade: h2c header. If the server supports HTTP/2, it replies with HTTP 101 Switching Protocol status code. The HTTP Upgrade mechanism is used only for cleartext HTTP2 (h2c). In the case of HTTP2 over TLS (h2), the ALPN TLS protocol extension is used instead.
Tags:
schema.org micro-markup
Download List of All Websites using schema.org micro-markup
Schema.org is a collaborative, community activity with a mission to create, maintain, and promote schemas for structured data on the Internet, on web pages, in email messages, and beyond.
Tags:
Google Direct link
Download List of All Websites using Google Direct link
this website is linking to google in its page.
Vary Header check for User-Agent
Download List of All Websites using Vary Header check for User-Agent
When using the Vary: User-Agent header, caching servers should consider the user agent when deciding whether to serve the page from cache
Tags:
Vary Header Accept-Encoding
Download List of All Websites using Vary Header Accept-Encoding
The Accept-Encoding request HTTP header advertises which content encoding, usually a compression algorithm, the client is able to understand. Using content negotiation, the server selects one of the proposals, uses it and informs the client of its choice with the Content-Encoding response header.
Tags:
XFN 1.1
Download List of All Websites using XFN 1.1
XFN is a technical term that is an acronym that stands for “XHTML Friends Network.” This is primarily used by websites that want to create a series of referral links between other websites in order to boost SEO ratings.