URL crawler?
-
All,
I am looking for a software that can crawl a specified URL and then report all incoming links to that URL.
For example. I would like to find out all incoming links to http://www.mysite.com/article1. Preferably internal and external links. So I might expect to a list like this:
http://www.mysite.com/article2
http://www.mysite.com/article3
http://www.mysite.com/article11
http://www.anothersite.com/article199
Does such a thing exist? I have Xenu Link Sleuth, but this crawls all links on my site and just reports on broken links, which isn't the most helpful tool for the purpose I need it for...
Thanks
Matt
-
Not totally sure if my answer is correct, but I do believe that IIS SEO Toolkit allows you to do that kind of verification.
Edit: stupid me > OSE
-
Thanks Gianluca. IIS access isn't available to me at this particular moment, unfortunately.
Are you (or anyone else) aware of any third party software?
Thanks
-
Maybe I am missing something here but can you not use opensiteexplorer.org?
So, you want all links to say this page from internal and external sources:
http://www.seomoz.org/blog/how-much-does-google-makeA standard search (default settings in open site explorer) gives you just that:
http://www.opensiteexplorer.org/links?site=www.seomoz.org%2Fblog%2Fhow-much-does-google-makeYou can then just dump all this info out to a spreadsheet and manipulate it as needed.
Hope that helps.
Marcus -
Thanks for all of the responses. I wasn't aware of opensiteexplorer.org and it does seem pretty handy. Not sure I 100% trust it (a few common sense checks displays some, but not all links), but it's a good starting point.
Cheers
M