Crawler issues

[Kara.Wallace]

Hi Craig,

Did you submit your sitemap in Google Webmaster Tools?

Mike

[GPainter]

I would agree with Mike you can see how here - https://support.google.com/sites/answer/100283?hl=en-GB

How long have you had the site up for? Remember it can take time for it to get crawled. You can ask google to crawl a page but this can still take time.

Good luck.

[DougRoberts]

Tried to crawl your site with Screaming Frog and noticed that your http response header contains a  x-robots-tag which is being set to noindex, nofollow.

You can check your http headers on this site: http://web-sniffer.net/

[AdamWormann]

Double check your redirects again.  When I tried to check your backlinks, I was showing redirects between tasteinc.com, www.tasteinc.com, and www.tasteinc.com/   Every time I tried to find the profile using one of those links, it would tell me that it redirects to another one of those.

I didn't have a problem going to your site, but the way that software was trying to crawl things, I would double check that again.  That's the only issue that I saw.  Has the site been up long?

[CleverPhD]

whoop there it is!

[CheethamBellJWT]

Yep. We did that. Thanks for the suggestion.

[CheethamBellJWT]

Thanks for your help Chris

[CheethamBellJWT]

Thanks Doug. That is really helpful.

[CheethamBellJWT]

Thats a good point Adam. Thanks for your assistance.

[GPainter]

No problem, happy to help