How do you find Affiliate Links on your site that have not been nofollowed?

[Zippy-Bungle]

We've just signed up to an affiliate scheme because we were sending links to them because we thought their product was valuable to our users. So we now have to go through and nofollow all of these links over 100's of pages.

Is there any way that do a crawl of the site to identify all links to a particular site and tell me what page they are on and whether they are nofollow/follow?

[MoosaHemani]

I am not sure if there is any link but I guess if you run screaming frog that will tell you how many of links that are going out contain follow and no follow tag but again for that you actually have to go URL by URL so this will not really going to cut any of your time.

I would love to hear from any other person in the community who is either using this kind of tool or know this kind of tool exist.

[ecommercebc]

Hi there,

There's a few options for this outside of Screaming Frog, but they depend on how your site is developed.

My first thought would be to write a small script that looks for instances of this domain and checks if the link is nofollow, if not it inserts a nofollow tag. Depending on how your site is coded this could be risky, but I think you could do something nifty in PHP if you know the site and the language well. This is probably a quick-fix but not a massively sustainable solution as you'd be running a function each time - might get a bit laggy? It'd allow you to provide a quick-fix to the issue while you work on it separately, depending on how your site is developed.

An alternative you could do, if you use a system such as Wordpress would be to Export an RSS feed of content and use Notepad++'s regex find and bookmarking to highlight all instances of this domain within your page content where you don't use nofollow and replace with nofollow versions. This is time consuming, but would work. Also relies on Notepad++ not dying due to the size of the RSS feed!

Another alternative would be to use OSE and create an advanced report, which looks at only Follow links that come from your root domain and point to the affiliate domain in question. This method relies on Moz crawling your links and finding them - Might be tricky if those links are new.

You could also use Xenu to find only external links pointing out to that domain from your website and go through them manually. But that's not much fun either.

Hope there's something there that can be gleaned or used!

[Chris.Menke]

Actually, screamingfrog should take care of it for you via the custom spider configuration.  If you select "custom" under the "configuration" tab, you can drop in the html for the links you are looking for and it will give you a report with what pages it finds that code on.

For example, have screammingfrog search for the following snippet of code and it would find nofollow links pointing at mysite.com:

rel="nofollow" href="http://mysite.com