Welcome to the Q&A Forum

Hi,

Try using any other crawler to see if they provide you with the same message (ScreamingFrog), in some cases it could mean that the site is overloaded and will start blocking the crawler. We're doing something similar for ours as we have a lot of scrapers but exclude the 'good' sites.

Martijn.

Hi Mark,

It will always help as long as you remember that not everything in SEO will always get you an immediate return in terms of links of visitors but having a press release published on more sites would always help.

Hi there,

The filename for the disavow file doesn't matter, as you can point to it yourself when you upload it to Google.
Moz does not take your disavowed links into account as far as I'm aware, they have their own proprietary technology to identify sites that are more likely to be spam.

Martijn.

Hi Atul,

This is going to be an intimate morning ;-), you should add this code indeed in the of your page.

1. The 100 is the number of of milliseconds before the first parameter, the trackEvent in this case is set.
2. You're right on both counts.
3. The reports in Google Analytics could be found (in the new version of Google Analytics) under Content > Events > Overview.

Hope this helps (again)!

Hi Kashif,

Give it a try and let us know if you think it works, in our case it didn't change anything unfortunately. You usually have to wait like mentioned above a very long time.

Well, I wouldn't recommend doing it as from a development perspective it ain't great. But from an SEO perspective I would worry more about the other 299+ ranking factors that are out there. Basically having your CSS validated or HTML validated won't do much in 2017 for your ranking compared to all the other variables that are taken into account.

Hi Michael,

Redirect them to the homepage, in this case it doesn't make sense to disavow them as they probably won't hurt you because of the quality but more that they might be sending traffic to pages that don't exist. Forcing users to a page that they can do something on would be the most valuable thing.

Hi Andrew,

The Moz APIs are not capable of exporting the data for ranking tracking purposes. You would need for example need access to the AuthorityLabs API to do things like this.

If you worry about the 100 milliseconds it's OK. A second is 1000 miliseconds, so 1/10 of a second is between the click and the trackEvent.

Second confirmation ;-), he's right. It's one of the things that for bigger sites really could get you in trouble.

Hi,

Mostly look at Amazon, they've been doing some of this stuff for a while. Just not sure if they're changing the link structure based on colors or certain features. But it happens on a regular basis that they're changing things on the page according to the size or the color of the product that you're picking.

Martijn.

I would go with Disqus as it can use the data from Facebook to verify that you are an actual user and that you don't run into any issues because of that. It makes it more clear (as long as you use your own not FAKE profile) that you are a real human being.

Hi Andrew,

I'm also using EC2 instances to pull data from the Moz API but I don't have had any issues. Are you sure the script is working, what kind of programming language are you using/ script to pull the data in?

Martijn.

Hi Adam,

I would recommend adding your site to Google Webmaster Tools, this will give you under Diagnostics data about the Crawl statistics from Google. This will tell you:

• The number of pages crawled per day.
• Kilobytes downloaded per day.
• Time spent downloading a page (in milliseconds)

Which in the end will look like this provided with graphs.

Hi,

Well in most cases category pages are ending in a slash because their ecommerce set ups are coded like that and for code purposes it's just easier to use a slash at the end then having to identify things without. I know for sure that at least 2 out of the 3 stores that you've listed definitely didn't think about it so far ;-).

Martijn.

Hi Scott, Interesting line of thought I must say, but unfortunately ads.txt is not a factor as there are also tons of sites out there that don't participate at all in using ads or anything of that nature that then immediately would be facing negative consequences of not using this file. I've worked for some sites that had this file up but first of all: the change that you make would be so small to dedicate just to that file that it would never ever be able to call itself a secret weapon in my opinion.

I have tried to upvote your response ten times, unfortunately works only once. Spot on.

This is B/ Strong, this is not.

Hi,

The Google Robots will look for the robots.txt in each individual root. So you need the robots.txt in the root of the subdomain not just the domain root. That's why its also possible to include a complete disallow in there and not just: .edit.com/* .

Example:
User-agent: *
Disallow: /

Hope this helps!

Hi Riccardo,

1. Yes, as the content from images for Google is harder to read and index then the written content now you've converted it.
2. Not really, you have to make sure that the HTML will look relatively clean but besides that it can't really hurt you as divs and spans are not causing issues in any way.