The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Getting Started
    4. Duplicate Content after Moz Site Audit

    Duplicate Content after Moz Site Audit

    Getting Started
    6 2 205
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jjimen03
      jjimen03 last edited by

      Hello folks,

      So I signed up for the trial version of the Moz tool and ran an initial site audit. One of the site audit results is confusing me.
      It reports that there are two pages with duplicate content ( Each page has a duplicate page with duplicate content in it).
      When I take a look at what those pages are, here is what I see:

      mysite.com/Contact-Us.html
      mysite.com/contact-us.html
      ( The difference in the above is the Contact and Us, the first letters are capitalized on one of the URLS)

      mysite.com/index.html
      mysite.com

      Now I am confused because for one thing, I don't have 2 Contact Us html files uploaded on my hosting server.
      Why is Moz seeing 2 Contact Us pages? How to remove one?

      Regarding my home page, why is it flagging the same page as two different pages? How to remove of them?

      1 Reply Last reply Reply Quote 0
      • ATP
        ATP last edited by

        Hi Jorge,

        lets take it from the top

        Moz tries to show you, and report on how google would see you site.

        When you type in a url, the browser and server holding and displaying the website doesn't care if you use capitals or lowercase, for their purpose it is the same page. This is why you will have only created this page once on whatever web platform you are using. However, google sees them differently, each one as a different page.

        You could access this page from any combination of capital letters even something stupid like

        mysite.com/CoNtAcT-Us.html

        These hundred of variations are never picked up on simply because we dont use them.

        Lets presume you wanted the the page to be reachable at  "mysite.com/contact-us.html" and made it this way. The reason the second variation has been picked up on is most likely because you have used it (or someone else has) to link to that page. Somewhere somebody will have  Link Text

        Because of this link the second variation is found and because google treats it as a different page, moz is reporting it as a different page.

        It is a similiar case with your

        mysite.com
        mysite.com/index.html

        Is is the same page accessible at 2 different urls.

        To combat this, you need to use a solution such as

        1. Canonical Tags (Recomended)

        On your homepage get this code inserted between the tags

        On your contact page get this code inserted between the tags

        This will cause all versions of this page that are "accidentally made" to say "Hey, im just a copy of this page"

        2. 301 Redirects
         The second solution is to put a 301 redirect in place, this varies depending on what web platform you are on. This simply redirects the user and any crawl bot to the intented page

        i.e.  someone tries to go to   mysite.com/index.html and your website stops it loading and sends them to mysite.com

        This is normally done by editing your htaaccess file. If you want to go this road tell us what platform you website is on and we can give you instructions.

        jjimen03 1 Reply Last reply Reply Quote 2
        • jjimen03
          jjimen03 @ATP last edited by

          ATP,

          Thank you for the information. So I did a bit of poking around on the site and found that on a few pages, the Contact-Us.html link was in fact capitalized on some pages and on others it was not. I proceeded to capitalize the first letters of each word on all the link references on all the pages, and re-ran the site audit, and the tool no longer flags the Contact-Us pages as being duplicates. Great stuff.

          I then proceeded to look for links in any of my pages which have either www.mysite.com or www.mysite.com/index.html and did not find any differences. All of the links in the code are pointing to the home page using: 

          So if I understand the fix correctly, I would have to go to my index.html page and in the header insert the following:

          [This would tell the search engines that the real version and all the "link juice" should go to www.mysite.com.

          Which brings up another question, should I use the www. version or the non-www. version? See I have the non www. version as my preferred domain set in my hosting provider, as well as in Google Webmaster Tools ( Google Search Console ).](/index.html)

          ATP 1 Reply Last reply Reply Quote 0
          • ATP
            ATP @jjimen03 last edited by

            Hi Jorge, sorry for the delay responding i was away for the weekend.

            You most likely don't have any links pointing the   mysite.com/index.html

            Index.html is the default hompage for most websites. mysite.com  technically points to a folder and searches for the index.html file within this folder. As such, both address for your homepage are nearly always found.

            A canonical will fix this, if you have the non-www version as your preferred domain go with

            Many people prefer to 301 redirect this page as its neater in the browser. But the canonical will do the job.

            1 Reply Last reply Reply Quote 0
            • jjimen03
              jjimen03 last edited by

              No worries on the delayed response. It is important to enjoy your weekend!

              Regarding the 301 redirect, now I must ask, what do you mean by "neater" in the browser?

              Just trying to get all the information and understand what I am doing before I go ahead and modify anything.

              Appreciate the help.

              ATP 1 Reply Last reply Reply Quote 0
              • ATP
                ATP @jjimen03 last edited by

                Sure thing,

                Using a canonical only would still let you access mysite.com/index.html and would display that url in the browser. This means 2 things, firstly a user can see this url (and it can look a little messy) if they happen to find their way onto this page and 2, they may link to your website using this url (many people copy and paste links from the browser window). Whilst this isn't a problem as the canonical would pass link juice anyway it makes things a little "messy".

                A 301 would do exactly the same as the canonical in terms of passing link juice etc but it wouldn't let the user access mysite.com/index.html  they would be redirected to mysite.com  removing the possibility anyone would see or link to  index.html

                Both solutions fix your problem, one is just a little neater.

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Moz site crawl doesn't work
                  DrainKing
                  DrainKing
                  0
                  4
                  82

                • Moz Site Crawl can't index WIX sites
                  samantha.chapman
                  samantha.chapman
                  2
                  2
                  680

                • Why does the MOZ bar not work on SERPs with site links?
                  samantha.chapman
                  samantha.chapman
                  0
                  2
                  73

                • Moz was unable to crawl your site - robots.txt
                  JRGRDZ
                  JRGRDZ
                  0
                  5
                  386

                • Duplicate Page Content and Title
                  David-Sulak
                  David-Sulak
                  0
                  5
                  164

                • A lot of duplicate content issues - does Moz understand canonical URL?
                  max.favilli
                  max.favilli
                  0
                  3
                  656

                • New to using MOZ. Familiar with Google Analytics. With MOZ is there a code snippet to include on my site?
                  Ron_McCabe
                  Ron_McCabe
                  0
                  2
                  88

                • What is the "other" group in traffic to your site on the moz dashboard ?
                  Abe_Schmidt
                  Abe_Schmidt
                  0
                  4
                  127

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy