Can't find X-Robots tag!

[Blink-SEO]

Hi all. I've been checking out http://www.unthankbooks.com/ as it seems to have some indexing problems. I ran a server header check, and got a 200 response. However, it also shows the following:

X-Robots-Tag:
noindex, nofollow

It's not in the page HTML though. Could it be being picked up from somewhere else?

[ThompsonPaul]

Tags can also be set in the .htaccess file, Blink - though not usually x-robots. (I use it to add canonical tags to pdfs to point them to the parent page, for example).

It's a long shot, but check there in case a dev decided to block the site from indexing that way during development.

Hope ya find it!

Paul

[Martijn_Scheijbeler]

Hi,

You won't find the X-Robots tags in the HTML of your page as they're send within the headers of a document. These details could be set via your server. That's also the place you'll have to look to change something like this. I tried to give you an example, but somehow I can't ping your site and it returns a 406 error.