Sitemap links

[ceci2710]

Hi, I´m running a sitemap using pro-sitemaps and I find several pages that shouldn´t be listed. How do I find how are these pages being generated? Can´t find the links the robot is following to get to those pages..

[Ray-pp]

Have you considered using a tool like Screaming Frog SEO Spider?

It can crawl your site and it will list the inbound links to pages all neatly in a tab (exportable to Excel).

[ceci2710]

Will try doing that thanks!

[ceci2710]

Hi Thanks for your help! I keep getting "Connection Refused" status from the Screamin Frog..just couldn´t use it..I have tried the proxy, firewall and all recommended steps for solving this issue..

Is there a similar app?

Thanks!

[Ray-pp]

Screaming Frog is the best crawler out there imo. Have you talked to your hosting provider? They may be refusing the connection on their end.