Welcome to the Q&A Forum

I'm working on a link removal project for two sites (both under manual action penalty) with LOTS of spammy links and need to find a bulk email scraper tool that will let me easily get webmaster contact info at scale.

The first site I'm working on has over 7,000 referring domains and the second site has about 11,000. I need to start reaching out to these webmasters to try and get the links taken down.

I've tried tools like BuzzStream and Removeem, and although they do a great job at finding info at scale, you have to reach out to each webmaster individually. Given that the vast majority of the links are spammy, I need to reach out on a wider scale and at a faster pace.

I've also tried free tools like Bulkseotools' Whois Lookup, but again, it's not scalable and I'm not sold on how accurate the info is.

I did also consider Scrapebox, but heard it's very inaccurate and the contact info can't be trusted.

Any ideas?

Jeremy - it's available in the free version and if you click on Mode > List you can upload a file. I'm crawling 75K URLs and had to manually increase my memory so it would crawl faster.

Instructions on that here:

http://www.screamingfrog.co.uk/seo-spider/user-guide/general/#5

Good luck!

Jeremy/Kurt - I'm in the same boat. Have 75K URLs I'm trying to check as part of a link pruning project.

There's actually another Moz Forum post (http://moz.com/community/q/mass-404-checker) that has a very similar ask and responses are largely the same.

Below is a link that was mentioned in this post, but I've tried it a few times and it keeps getting hung up on any list over 100 URLs.

http://www.tomanthony.co.uk/tools/bulk-http-header-compare/

Below are the only other ones I've found, but again are limited to 100 or less URLs.

http://httpstatus.io/

http://tools.seobook.com/server-header-checker/?page=bulk&typeProtocol=11&useragent=1

I feel like this is such a common problem for people trying to do any kind of mass back link research project. I'm also looking for something that checks follow vs nofollow so I can further narrow my list.

Maybe we should just create the tool? : )