Welcome to the Q&A Forum

Hi there, The third URL you are referencing, is actually indexed: https://dmitrii-regexseo.tinytake.com/tt/NDY4NDY4N18xNDgzNjgzMA As for "crawled, not indexed" - in most cases it happens because of one and only reason - Google is seeing your page as thin content, not worth being indexed. Typically it happens on bigger sites with a lot of similar pages. In your case, you got many courses, with exactly same structure. So, if the content is not completely different, then Google might deem it not worthy. As for the bug you referenced - did your URLs drop off the index exactly at the time when this issue has been discovered? (aka within the last week?). Do you have any cannibalization happening? To me it looks like that's the case. If I do this search: "site:https://www.ihasco.co.uk/ Sexual Harassment Training course" There are many pages that are indexed and are ranking: https://dmitrii-regexseo.tinytake.com/tt/NDY4NDcwN18xNDgzNjg4Mg So, basically, you have pages that are more authoritative with similar content. Therefore your courses pages are dropping as thin content. I would recommend doing some internal linking optimization to tell Google what is actually important. Look in GSC for internal links metrics. Hope this helps.

Brilliant! good luck with it. Please do me a favour and hit the 'good answer' button thanks 

If the Disallowed URLs are linked to externally, or internally from a page that isn't Disallowed, they'll appear in the index with the snippet text you've quoted. If you want to ... Typically, that page will already be populated with parameters the crawler has discovered, though you can specify them manually too.

Howdy iHasco! Big site changes like this can always be tricky. Depending on how often these paginated pages are indexed and how many external links are currently pointing to them (I'd take a look and analyze both of these things before making any concrete decisions). Either of these decisions could be an okay route. 404 ing them is appropriate if the pages arn't indexed in Google, and have no backlinks.  (Be sure to remove all internal links pointing to them as well) 301 redirecting these pages is the correct route if your pages have link equity you want to preserve or the pages are indexed and users could potentially still access them from the SERP. Since the blog homepage will contain the content these users would potentially be looking to access, I think that the blog homepage is the correct page to redirect to, as it will house the same content as the pagination used to have.

The big problem is your redirection. At the moment, you DO NOT redirect people on the https website. Read more about the changes you have to make here -> https://moz.com/learn/seo/redirection. Basically, if you run on Apache, you need to modify your htaccess file and everyone who lands on the non-ssl version should be redirected to the https one. A quick Google search will give you examples of rules to include in your file. For example: https://uk.godaddy.com/help/redirect-http-to-https-automatically-8828. In terms of the questions you asked: you should modify the settings of the website and set the https as the preferred version. You shouldn't have two different sitemaps. The non-ssl one should not even work (it should be redirected as mentioned above) Of course your robots.txt version should include the https links. Again, the one without them should be already redirected. Hope this helps.

Many thanks, Donald - hugely appreciated!

Hi there, These look like they might be broken mailto links. If you shoot us an email at help@moz.com, we'll take a look in your campaign and see whether we can pin down the root cause for you.