Welcome to the Q&A Forum

You not always have to do this, if you would go to domain.com/robots.txt then it should be removed maybe already. If that's the case you should be starting to see an increase in the number of pages crawled in Google Search Console.

In addition to what Nigel is suggesting I would also recommend to claim www.example.com and example.com, if you used to have a HTTP site and have moved over the last years to HTTPS I would recommend using that to verify as well. All of this gives you the best insight.

This is only worth fixing as it's usually an easy change that needs to be made, right now it won't hurt you as there are so many other issues that have way more weight for a search engine. This particular one is one that millions of sites have.

Hi Sarah,

This is definitely not cloaking as that is something different from what you're describing. That is more related to Google showing something completely else then to your users. I would go with your suggestion and make sure that the reviews would always be included in the first view so you can make sure to both your users and to Google that it's the most important one.

Martijn.

Look at the potential, are these URLs that you currently are receiving search traffic for. If that isn't the case I would hesitate on changing them as it's work that might not provide you with any benefit.

Yes, I would advise to go with Yoast as well. Their team is very approachable and their updates are very fast for new features.

Hi Allie,

You would only have to add this to your homepage. From the other pages you can then reference this code within the Schema.org so it doesn't have to be included multiple times.

Martijn.

Hi,

What I would do is go with both the canonical URLs as the Google Search Console parameters, in order to make sure first that the pages won't be seen as duplicates with the canonical URLs and in addition to that you might want to make sure that Google isn't visiting these pages at all in order to save your crawl budget for the more important pages on your site.

Martijn.

Hi,

I'm afraid I have to help you with this dream, there is no connection whatsoever between the rankings and the feature to Fetch as Google within Google Search Console. What likely is happening is that you're already getting personalized results and within a certain timeframe, the ads won't be shown as the results will be different as Google thinks that you've already seen the first results on the page the first time that you Googled this.

Fetch as Google doesn't provide any signal to the regular ranking engines to say: "Hey, we've fetched something new and now it's going to make an impact on this". Definitely not at the speed that you're describing (within seconds).

Martijn.

Yes, we're a news site as well and in our case we want to make sure the low quality pages on TNW aren't indexed.

Ok, that still doesn't mean that they're not personalized. But I'll skip on that part for now.
In the end, the changes that you're seeing aren't triggered by what you're doing with Fetch as Google. I'll leave it up to some others to see if they'll shine a light on the situation.

I wouldn't say that Google would start ignoring the more often but more that it might be that they're going to use other pieces of the text that they think might be mor relevant or changes the capitalization themselves in the SERPs while using your own text.

Hi Julie,

I can confirm what Gaston says, there is no additional value in changing the extension (or adding one) on files. In the end, it's not something that Google pays any attention nor adds any value to. That's why I would rather focus my energy on any of the other dozens of factors that do play a role in ranking higher.

Martijn.

Reviews can work perfectly for user generated content to make sure that the content is a bit more unique. It's an easy one and I'm probably hitting an open door here but depending on how much products you sell for a specific version it might help you to extend both the content and make it more unique.

Based on your response and the idea that you only have 50 pages that you actively care about. Likely it's not the right tool for you. You're probably better off with a tool that is way more focused on on-page optimization for the keywords that are important to your business. I would start worrying about crawl behavior on a site that is scalable and have over 10.000+ pages that regularly change.

Hi,

Don't think that at the moment e-commerce is the focus of the AMP project. At the moment I think they're mostly working with publishers (like us) in making sure that articles that people read will go faster as publishers are usually the slowest sites on the Internet because of all the ad-setups. Maybe they're moving more towards other sites later on.

Hi,

Have you checked the plugins that you're using within Firefox? It could be that one of the plugins will be causing the issue and is appending this to the actual URL.

Martijn.

Yes they will be eventually. As you disallow Google to crawl the URLs it will probably start hiding the descriptions for some of these image pages soon as they can't crawl them anymore. Then at some point they'll stop looking at them at all.

Hi Rogier,

1. Yes, this is usually counting towards crawl budgets as Googlebot is doing this per request.
2. It depends on how your request is being set up obviously, otherwise, I would advise going with the exclusion for the robots.txt that you're already heading towards.

Hope this helps!

Hi Dieter,

What does Google Search Console show you in terms of images crawled and images indexed? Usually the images sitemap's indexation rate is way lower then the one for web pages so that would make sense. But no indexation at all would mean there's probably a problem outside of your sitemap.

Hi Tom,

Likely due to the internal linking structure of the subcategory your page /kinderfiets/kinderfiets is ranking better or it just has some more history/relevance. My guess is that it's likely a close call knowing the Dutch market a bit. You're mentioning that the canonical tag is active, but they're also both unique as they are self-referencing. So basically they don't play a role at all as you're suggesting that they're not the same page and both could rank.

Martijn.