A week ago I asked how to remove duplicate files and duplicate titles

[FFTCOUK]

Three weeks ago we had a very large number of site errors revealed by crawl diagostics. These errors related purely to the presence of both http://domain name and http://www.domain name. We used the rel canonical tag in the head of our index page to direct all to the www. preference, and we have no improvement. Matters got worse two weeks ago and I checked with Google Webmaster and found that Google had somehow lost our preference choice. A week ago I asked how to overcome this problem and received good advice about how to re-enter our preference for the www.tag with Google. This we did and it was accepted. We aso submitted a new sitemap.xml which was also acceptable to Google. Today, a week later we find that we have even more duplicate content (over 10,000 duplicate errors) showing up in the latest diagnostic crawl. Does anyone have any ideas? (Getting a bit desperate.)

[donford]

Making sure I got it right..

You fixed your index/root problem with a canonical tag, then submitted a site map, now Google has found thousands of duplicate titles?

If this is correct can you give a couple examples of the types of urls that are being flagged as duplicate, and also let us know if you use any CMS (WordPress,Joomla,Oscommerce etc...)

That will help us, help you,

Don

[FFTCOUK]

Hi,

Thanks for the response.

No CMS

Ecommerce site using Actinic which used pl files

examples:

<colgroup span="1"><col span="1" width="483"></colgroup>

http://fly-fishing-tackle.co.uk/acatalog/Fulling_Mill.html
http://fly-fishing-tackle.co.uk/acatalog/fishing_nets.html
http://fly-fishing-tackle.co.uk/acatalog/abu_garcia.html
http://fly-fishing-tackle.co.uk/acatalog/orvis_fishing_glasses.html
http://fly-fishing-tackle.co.uk/acatalog/giorgio_benecchi.html
http://fly-fishing-tackle.co.uk/acatalog/snowbee_lines.html

http://fly-fishing-tackle.co.uk/acatalog/special_offers.html

dulpicated as:

<colgroup span="1"><col span="1" width="485"></colgroup>
|   |
| http://www.fly-fishing-tackle.co.uk/acatalog/Fulling_Mill.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/fishing_nets.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/abu_garcia.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/orvis_fishing_glasses.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/giorgio_benecchi.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/snowbee_lines.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/special_offers.html |

|

[donford]

Okay so not bad. You just need to deal with www and non www urls.

If you have access to your htaccess file you can do it very easily with

RewriteEngine On RewriteBase / RewriteCond %{HTTP_HOST} !^www.fly-fishing-tackle.co.uk$ [NC] RewriteRule ^(.*)$ http://www.fly-fishing-tackle.co.uk/$1 [L,R=301]

[donford]

Then just make sure your site map urls are all www and resubmit.

[FFTCOUK]

Thanks for your reply.  This seems to be what I'm looking for.

I have entered it after our 301 redirects.  Hope this is best place in the .htaccess file.

Will let you know