Welcome to the Q&A Forum

Cheers @Andy & @Patrick

Hi Fred,

I haven't performed an extensive check, but the SEO Spider crawls around 35 URLs with /pi/ in the string, which is presumably not all the products on the site

Patrick actually mentions the issue in one of his points above. Essentially it looks like the site uses JavaScript on category pages for products, example - http://www.netspiren.dk/pl/Helse-Homøopati-Allergica-Ron-serien_58721.aspx

If you disable JS in your browser, you'll see a blank page where the products were. Our tool doesn't execute JS, although Google is much smarter and often can.

However, I'll leave you to verify that -

http://webcache.googleusercontent.com/search?q=cache:HBwmVULX5zYJ:www.netspiren.dk/pl/Helse-Hom%25C3%25B8opati-Allergica-Ron-serien_58721.aspx+&cd=1&hl=en&ct=clnk&gl=uk

Hope that helps!

Cheers

Dan

Hey Danatanseo,

The redirect chain report will report on chains of any redirects, whether 301, 302 (303, 307 etc) or a combination.

During normal 'spider' mode when you're crawling a full site, there isn't a special set-up, you can just crawl away and then export the report to see any chains that have been discovered.

However, (this will be relevant to Trung too :-), if you're auditing redirects in list mode (so for site migrations for example), then you'll need to remember to use the 'Always Follow Redirects' option and process discussed here -

http://www.screamingfrog.co.uk/audit-redirects/

You'll then be able to export a report which provides every URL in the original upload and their responses. For any URLs which redirect, the spider will follow the hop until they reach a 2XX, 4XX, 5XX etc and map these out for you in their row in the report. The report will also tell you how many hops there are and if there are any redirect loops etc as well. We built this specifically for site and domain migrations when you need to audit redirects from one to another, as it used to be such a pain in the @ss.

Hope that helps anyway.

Cheers.

Dan

Btw - You can always ping over any queries to our support (http://www.screamingfrog.co.uk/seo-spider/support/), I just happened to notice this thread via Google alert.

Cheers for the tweet Andy.

Chris, I'd recommend running through this list here in our FAQ -

http://www.screamingfrog.co.uk/seo-spider/faq/#17

In particular, I'd recommend reducing the crawl speed & adjusting the user-agent.

You can also pop it through to our support (http://www.screamingfrog.co.uk/seo-spider/support/) & we can advise. All confidential etc.

Cheers

Dan

Hello

I spotted this thread and was just about to reply, but Dirk has answered it all perfectly. Thanks Dirk!

Under 'reports' there's also a 'canonical errors' report which will show canonicals with various technical issues - Those that are blocked by robots.txt, have no response, 3XX redirect, 4XX or 5XX error (essentially anything other than a 200 ‘OK’ response). It will also show any URLs discovered only via a canonical, that are not linked to internally from the sites own link structure (in the ‘unlinked’ column when ‘true’).

Hope that helps anyway.

Cheers!

Dan

Not a problem, thanks for the kind comments both!

Cheers.

Dan

Hi Luke,

As the guys above replied with, sounds like an a href with a phone number

If you check the 'inlinks' (via the lower window tab), you'll be able to see the source of these errors (the pages they are located). Obviously you can then view the source code & find the exact link, and what might be the issue.

Hope that helps!

Feel free to pop through any further questions directly to our support btw (http://www.screamingfrog.co.uk/seo-spider/support/), I only spotted this via a Google alert.

(We try and reply super quick & will always look into any problems!)

Cheers.

Dan