URL not returning a page successfully
-
I am trying to use the on page grader however it is not working with my website. The url is:
http://www.britishhardwoods.co.uk/
Can anyone help?
-
Please see
robots.txt
Disallow: /index.php/Edit:This should only disallow crawling of any url with /index.php/ specifically in it. So it should "not" be the issue.
I can confirm that Moz page grader does not like http://www.britishhardwoods.co.uk/
I can confirm the site is crawl-able by bots tested with NinjaBot
-
I was looking at this issue to see if I could find anything specifically wrong, also kinda hoping somebody would chime in to help.
At any rate, I found this topic on Moz:
Though I been using Moz for a couple years I didn't realize how picky RoberBot can be. I did notice that your banner / slider is taking a fairly long time to load (10+secs here in the US). Perhaps Roger is not liking that?
-
Hello!
As a follow up to Donford who gave a relevant answer it could be a variety of things. This could include your hosting provider blocking our crawl as our server from Dallas can reach the site. The other thing may be delayed loads on the page due to the slider. The last thing that could be is if there are any javascript of dynamic redirects happening on this page Roger may turn away.
I would first check with your web host to see if they are blocking crawlers or if anything seems odd in your htaccess files. Next check the page for any unwanted or unneeded redirects.
Hopefully after these two items are checked you'll be back in action but please let me know if there is anything else we can do from our end.