Welcome to the Q&A Forum

I run a Magento shop - let's imagine a situation where the category landing page, is about "Joe Bloggs Kettles"

Then on that page, we have the products listed ; so we would have links to products pages - these links will be called something like:
Joe Bloggs Red Kettle
Joe Bloggs Yellow Kettle
Joe Bloggs Purple Kettle

Can someone please tell me if this is ok or should we rework our strategy?

Thanks

It is quite labour intensive to come up with product descriptions for all of our product range ... +2500 products, in English and Spanish...

When we started, we copy pasted manufacturer descriptions so they are not unique (on the web), plus some of them repeat each other -

We are getting unique content written but its going to be a long process, so, what is the best of 2 evils, lots of duplicate non unique content or remove it and get a very small phrase from the database of unique thin content?

Thanks!

I think you will find that even though you have good on page optimisation, your page is buried deep in the navigation -

Lawnmowers > Rotary Petrol Lawnmowers > 4 Wheel Petrol Rotary Lawnmowers > Self Propelled Petrol 4 Wheel Rotary Lawnmowers > YOUR PRODUCT.

Mozjuice, Linkjuice, is not trickling down to this deeply buried page - I would suggest reworking your site nav to make it flatter - easier for bots to pass link juice through and easier for humans too!

Good luck

I think you will find that the URL´s in Google´s index are either:

1. indexed prior to putting in the robots.txt disallow in place - check in the google serp and click on "in cache" to see the date.
2. Heavily linked to by other external domains.
3. Both of the above.

@cleverphd has a great solution. Follow that.

Thanks.

The URL's that Moz is reporting are clean and well formatted - No querystrings or anything, so they are reporting the clean URL as I want it to be indexed by Google. That's ok.

But there is Dupe on page content - text that has been copied and pasted, so it's a real issue - and its right in picking it up.

What I cant comprehend is why it's not reporting all of these at once, especially as its not reaching the crawl limit ever...

??

Using Magento myself.

Our site has around 8500 crawlable pages - no more - Ive confirmed the same with Screaming Frog Spider.

So I think Rogerbot is crawling the whole site every time - but not recognising the dupe content all in one go.

Any other suggestions?

I am chasing my tail on the duplicate content report on Moz.

My campaign never crawls more than 10000 pages - but yet, as time goes on, and just when I think I've got on top of duplicate content by removing it or disabling the pages, it peaks again and shows me other pages that have duplicate content issue.

These pages have remained the same during the last few weeks, and have been crawled so I dont understand why Rogerbot has not detected them before, "all in one go" - I seem to get dupe content appearing all the time with no changes to the website itself - its just Moz has not reported it till now.

Very frustrating. Help!

OK - so if I Geotarget UK via webmaster tools, will that exclude a lot of other countries??

We dont have a lot of links from France no...

Well that's the thing... Nothing, because we dont wish to particularly target any specific country...

Hi,

Our online shop is hosted with a French IP address. It is available in English and Spanish.

I have noticed, as to be expected, that we get quite a few french visitors, probably related to our IP address Google must think its geo related.

We don't want to particularly target any specific country, but more so english and spanish speakers.

Can you have various A records around the world to help with this? Any suggestions or things I could look into??

thanks

Hi,

I keep getting 404's appear in the Crawl Diagnostic error warnings.

How do I find out which pages are linking to these 404 pages? How is MOZ finding them?

thanks

Ben

Screaming Frog has an option in the menu -

Configuration > Spider > "Ignore Robots.txt"

Tick this box and re-scan and see if you get different results.

And also, may be worth checking this out:
http://moz.com/learn/seo/robotstxt

Good luck!

It's hard to say without knowing the domain name -

Have you tried Screaming Frog software to see if it also has issues crawling?

Double check your robots.txt to see if some directories and pages are blocked.

It seems like it takes Google Webmaster Tools to forever realize that some pages, well, are just gone.

Truth is, the 30k plus pages in 404 errors, were due to a big site URL architecture change.

I wonder, is there any benefit of using 410 GONE as a temporary measure to speed things up for this case?

Or, when would you use a 410 gone?

Thanks

Hi,

What is the best way to block googlebot etc momentarily? For example, if I am implementing a programming update to our magento ecommerce platform and am unsure of the results and potential layout/ file changes that may impact SEO (Googlebot continuously spiders our site)

How can you block the bots for like 30 mins or so?

Thanks

Hi,

Our online application, magento e-commerce, has a script that detects browser language and does a 302 redirection to the language of choice ... www.mydomain.com/en/ or www.mydomain.com/es/

What's the SEO angle on this? Should I be concerned?

thanks,

Ben

Hi,

I am running an ecommerce store - cookware, bakeware, knives etc...

I have someone I know personally that is a writer and one of her blogs is about cooking - lots of well established articles with keywords througout.

Is there any harm in getting some inbound links from her blog on certain keywords? If so, should I limit the number of outgoing links per article she has? Any guidelines?

Thanks!

Hi,

Our IP was recently blacklisted - we had a malicious script sending out bulk mail in a Joomla installation.

Does it hurt our SEO if we have a domain hosted on that IP?

Any solid evidence?

Thanks.

Love that Screaming Frog...

Hi David,

When did you add the tag? Was it added after 9 Jul 2013 19:08:35 GMT ? (this is when Google cached this page last).

I would advise you not to add it to Robots.txt - This only prevents page from getting into the index, but it does not remove pages from the index.

I don't think the formatting matters - e.g, the space or no space - see this link: http://googlewebmastercentral.blogspot.co.uk/2007/03/using-robots-meta-tag.html

I would guess that Google has not re-crawled the page since you added the tag in.

If you want to get rid of it quickly, use Google Webmaster Tools > Remove URL.