Questions
-
WEbsite cannot be crawled
Ok, I made a quick test of your robot.txt file and looks fine, https://www.threecounties.co.uk/robots.txt Then I made a test https://httpstatus.io/ to check the status code of your robot.txt file and show me 200 status code (So it's fine) Also, you need to make sure that your robot.txt file is accessible for the Rogerbot (Moz crawler) This day the hosting providers have become very strict with third-party crawlers This includes Moz, Majestic SEO, Semrush and Ahrefs. Here you can find all the possible sources of the problem and recommended solutions https://moz.com/help/guides/moz-pro-overview/site-crawl/unable-to-crawl Regards
Moz Tools | | Roman-Delcarmen0