Any tool to get all the old or archived links of a website?

[vtmoz]

Hi all,

We can see the old pages/links of a website using web.archive.org. But we need to manually check all the cached versions to know those. Is there anyway to get all those links/pages?

Thanks

[Martijn_Scheijbeler]

I can't think of a better alternative then the one you're already using. It depends a bit on your use case, if it's just about links you might be able to get some historical data from Majestic but that's probably not matching your intent.

[BlueprintMarketing]

This first method is a complete guess if it just went down you might have a chance of grabbing the rest on google of it by typing in sight:thedomain.tld  in google I don’t know how old this thing is so it’s a possibility.

Try http://archive.is Or time-travel.mementoweb.org

http://archive.is/20130504233657/http://moz.com/

You can find just links or html useing

http://www.internetfrog.com/mywebsite/archive/ with archive.org

Try when in  The way back machine  take the code and  use Regex to grab the URLs

https://www.quora.com/Aside-from-the-Wayback-Machine-what-are-other-options-for-getting-screenshots-of-websites-from-the-past

Use this inside of archive.org.

https://regex101.com/library/V36Bah

https://regex101.com/r/V36Bah/1

https://regex101.com/r/fbX1LZ/1

http://network.ubotstudio.com/forum/index.php/topic/12459-regex-explained-match-extract-urls/

https://mathiasbynens.be/demo/url-regex

Use google search inur:thedomain.tld any variation that you think will get your URLs

you never know what you might  find.

The site Get data from any link tools like Majestic, Ahrefs, Moz OSE that will  give you a outline of site structure if it was Crawl and I had a lot of back links you can get a lot of URLs that way.

One thing you have to do with the way back machine or archive.org. This simply use whatever page they have  and click on that look for the  site special by going to the homepage and trying to save that . So you can grab the URLs out of the navigation  outside of that and doing Google searches for anything  depending on how old it is it may still be there I don’t know how long ago this occur? But Google is not going to be a bad place to look.  After that going to Webmaster to look for a xml site map or anything you could have useed To crawl the website prior to it coming down.  If you know ran a crawl via Moz,  screamingfrog  or Deep Crawl you’re in luck.  call the hosting if you own the domain

Are you the new owner? If you are there might be a small chance the hosting company or the old owner had a back up of the entire site never know but you need to ask.

I wish you all the very best

sorry  about the formatting I’m on my cell phone

tom