Welcome to the Q&A Forum

Very good answer Elias. Thank you.

Thank you to everyone that contributed.

@Zeph and @Francisco - I do use Screaming Frog, but actually, correct me if I am wrong, but it does not show a list of pages indexed, but rather pages that exist in the site - not what Google has already indexed. Thanks anyway

What I wanted was a way of creating a list of all indexed pages in Google - not a count.

But thank you all the same!

Hi,

We have an ecommerce site with around 4000 real pages. But our index count is at 47,000 pages in Google Webmaster Tools.

How can I get a list of all pages indexed of our domain? trying to locate the duplicate content.

Doing a "site:www.mydomain.com" only returns up to 676 results...

Any ideas?

Thanks,

Ben

Hi,

I have a lot of near dupe content caused by URL params - so I have applied:

How long will it take for this to take effect? It's been over a week now, I have done some removal with GWT removal tool, but still no major indexed pages dropped.

Any ideas?

Thanks,

Ben

Thanks.... was starting to wonder whether I needed a space or something...

I have this without a space:

with a space:

Shouldnt make much difference but as it's taking time for Google to notice just curious...

Hi,

Is this syntax ok for the bots, especially Google to pick up?

Still waiting for Google to drop lots of duplicate pages caused by parameters out of the index - if there are parameters in the querystring it inserts the code above into the head.

Thanks!

Hi,

Our on page optimization, albeit for a few dupe content issues, is ok - We have good keyword rich URL's, Titles, H1's and unique product descriptions.

So now I want to look at building links that will boost our DA and PA's.

We have over 2000 products on the store and around 130 categories/subcategories -and I would appreciate any views on where to start -

My initial view is to get backlinks from the relevant manufacturer websites to the "shop by brand" page on our site related to these manufacturers -

What other strategies should I look at?

Thanks,

Ben

Hi,

Any simple methods to boost Domain Authority?

Thanks,

Ben

Hi,

Our sitemap is created by our e-commerce software - Magento -

We are probably going to make a lot of products Meta No Index for the moment, until all the content has been corrected on them - but by default, as they are enabled, they will appear in Sitemap.

So, the question is:

"Should pages that are Meta NOINDEX be listed in a sitemap"? Does it matter?

thanks!

Hi,

So, we know we don't have the best content - so we are hiring writers to create unique content for each product.

What happens if this is now copied by another website? What does Google see? Do they recognize us as the original content?

Has anyone used DMCA.com ? is it worth it?

thanks,

Ben

Hi,

Our e-commerce store has a lot of product descriptions duplicated - Some of them are default manufacturer descriptions, some are descriptions because the colour of the product varies - so essentially the same product, just different colour.

It is going to take a lot of man hours to get the unique content in place - would a Meta No INDEX on the dupe pages be ok for the moment and then I can lift that once we have unique content in place?

I can't 301 or canonicalize these pages, as they are actually individual products in their own right, just dupe descriptions.

Thanks,

Ben

Thanks Tom.... Very valuable info.

A bit of background: we are running an e-commerce site - so I'm dealing with various forms of dupe content:

1. Descriptions that are copy pasted from manufacturers - e.g, replicas elsewhere - we are addressing this by writing our own content.
2. Dupe content between pages due to the products only change in colour or size - I am going to make these configurable products, so group them into one page.
3. URL params - this is a nightmare! Basically faceted navigation that is causing the same page to show very near similar content under different URL's.

Anyway, slowly fixing these - just seems like Google is painfully slow to respond to our work on improving things. Hence the question...

I am trying to assess the impact of duplicate content on our e-commerce site and I need to know if the duplicate content is affecting only the pages that contain the dupe content or does it affect the whole site?

In Google that is. But of course. Lol

If I have internal links pointing to pages that are META NO INDEX, will Google still index them?

Or does that only apply to pages that are linked to from an external domain?

Thanks!

Thank you Carson.

I will check those pages to see if they contain and UGC on the product review sections - and will follow your other recommendation also.

Hi,

Interesting question which I have considered in the past also.

I think that so long as your prices are competitve, it is a good idea - depending on how you are pricing your products compared to the competition.

One thing to be aware of though, for example, I use Magento, and I know that the structured data in our setup does not always take the "final price", eg, it takes the regular price - we run discounts on most of our products, and getting it to display the "final price" would be important in my opinion - so that your lowest price is always displayed as opposed to your regular price.

There can be of course a downside - customer's see your price and make a decision immediately not to even visit the site - sometimes less is more.

Hope that helps.

Hi all,

We run an e-commerce store - I am just looking at the apache logs and I am finding a lot of spammy links that have been referrers to our pages - when I check the links, I cannot find our URL in an HREF on their page so I presume they may be using some country based cloaking?

These are the domains that are targeting specific pages on our site:
http://3xru.ru/
http://saldoconsult.ru/
http://euro-casino.ru/casino/
http://delaymoney.maroderi.ru/
http://intimhot.ru/

How to deal with this? Our site is about cookware and they seem to be pointing these links to very specific products and categories.

Never seen anything like this before, help would be appreciated.

Thanks,

B

Thanks again Mike...

Our URL structure I think meets Google's requirements - but there is yet no breadcrumbs appearing... does that appear depeding on domain reputation?

So once Google has started to see the meta-noindex and is slowly deindexing pages, once that is done, I would like to block it from crawling them with a robots.txt to conserve my crawl budget.

But, there are still internal links on the site that point to these URL´s - would they get back into the index in this case?

Yes, that makes sense thank you. Although I have read on some of this forum that a forward slash helps rank better?

I also thought that by doing slashes in the URL, Google may have added those special links underneath the listing

Mybusiness > Shoes > Mens Shoes

Thank you for your help