MOZ crawler 404 errors on wordpress

[vaineh]

Hi all,

I've got hundreds of issues coming up on the MOZ crawler with 404 errors, I don't know what these URL's are. Here's a couple of examples;

http://www.theswagbagco.co.uk/category/watford/http%3A%2F%2Fwww.theswagbagco.co.uk%2F2015%2F10%2F15%2Fnew-products-2%2F
http://www.theswagbagco.co.uk/2015/10/01/thank-you-epsom/http%3A%2F%2Fwww.theswagbagco.co.uk%2F2015%2F10%2F01%2Fthank-you-epsom%2F

See the first one is one page with a different url appended, the second is the same thank-you-epsom url. How would I find out where these are even being linked from?

[tawnycase]

Hi there! Tawny from the Help Team here. Thanks for writing in - this is a great question.

In order to find the page our crawler was on when it encountered a 404 error, I'd recommend requesting the full crawl CSV via the 'Email CSV' button in your 'Site Crawl' section.

From there, you'll want to check the referrer URL for the page that 404s. To do that, find the URL of the page in column A of the CSV and locate the referrer URL for that page in column AM. The URL in column AM is the page our crawler was on when it ran into the link for the page that results in a 404 in the browser.

I hope this helps identify where these are coming from - if there's any additional information you're needing, please don't hesitate to let us know! You can write in to help@moz.com any time if you need a bit more guidance.