URLS appearing twice in Moz crawl

[imrubbish]

I have asked this question before and got a Moz response to which i replied but no reply after that.

Hi,

We have noticed in our moz crawl that urls are appearing twice so urls like this - http://www.recyclingbins.co.uk/about/ www.recyclingbins.co.uk/about/

Thought it may be possible rel=canonical issue as can find URL's but no linking URL's to the pages.

Does anyone have any ideas?

Thank you

Jon

I did the crawl test and they were not there

[ben_dpp]

Hi Jon,

Just to clarify is your report showing the domains with http and without, or with www. and without as the duplicate content?

i have seen this issue on a couple of my sites where it is reporting with and without www. and have just implemented the rel canonical to point towards one or the other as i am very confident that this will resolve the issue.

I'll let you know the outcome.

Regards,
Ben

[DavidLee]

Hey Jon!

There are only two ways for these URLs to be picked. Relative links in the source code or malformed sitemaps if the <loc>tags are not on the same line as the URL</loc>

Incorrect:

<loc>www.domain.com</loc>

correct:

<loc>www.domain.com</loc>

If the linking page or referral URL is the sitemap, look in the source for the tags. If they are from another linking page, look for hyperlinks missing http://

the relative link would be

Hope this helps!