The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Duplicate page found with MOZ crawl test?

    Duplicate page found with MOZ crawl test?

    Other Research Tools
    4 3 292
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • rhondafranklin
      rhondafranklin last edited by

      When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page:

      http://www.radiantguard.com and http://www.radiantguard.com/

      Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND

      is this because of how my rel canonical is set up?

      1 Reply Last reply Reply Quote 0
      • RyanPurkey
        RyanPurkey last edited by

        Hi Rhonda. Google has a nice article on this very subject here: https://webmasters.googleblog.com/2010/04/to-slash-or-not-to-slash.html The main point is that it's a best practice to choose one or the other format for your locations.  From the article:

        You can do a quick check on your site to see if the URLs:
        http://<your-domain-here>/<some-directory-here>/
        (with trailing slash)
        http://<your-domain-here>/ <some-directory-here>(no trailing slash)
        don’t both return a 200 response code, but that one version redirects to the other.</some-directory-here></your-domain-here></some-directory-here></your-domain-here>

        If only one version can be returned (i.e., the other redirects to it), that’s great! This behavior is beneficial because it reduces duplicate content. In the particular case of redirects to trailing slash URLs, our search results will likely show the version of the URL with the 200 response code (most often the trailing slash URL) -- regardless of whether the redirect was a 301 or 302.

        A 301 redirect is best as it should be the permanent structure of your site moving forward.  Cheers!

        1 Reply Last reply Reply Quote 1
        • ChiarynMiranda
          ChiarynMiranda last edited by

          Hey Rhonda,

          I took a look at your crawl test and I don't see that we are reporting any duplicate pages for http://www.radiantguard.com or http://www.radiantguard.com/. We are actually reporting that http://www.radiantguard.com/ is the canonical tag of http://www.radiantguard.com and we would never report a page as a duplicate of the canonical tag. We do consider these two pages as separate pages, as many sites do also treat them differently, so we try to encompass the most sites with the way we report on pages with trailing slashes.

          You may still want to consider Ryan's advice regarding how to deal with these two pages, however, I just wanted to clarify that we are not reporting any duplicates on either pages. Here is a screenshot of the CSV that shows that these pages have no reported duplicates: http://www.screencast.com/t/5FHTfyQe

          I hope that helps to clear things up a bit, but please do let me know if you have more questions about the crawl report.

          1 Reply Last reply Reply Quote 2
          • rhondafranklin
            rhondafranklin last edited by

            Thanks Ryan and Chiaryn!  All looks good then!  So happy 🙂

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Need help fixing a duplicate content issue for my website. The moz crawl is show OMG my website with https:// and https://www. But I have never used the url https:// so I don’t understand why moz is showing this
              RossKernez
              RossKernez
              0
              4
              58

            • Moz Top Pages and Tool Bar Not Crawling Internal Pages and Links
              dave.kudera
              dave.kudera
              0
              2
              42

            • Moz Site Crawl Test 404
              Dr-Pete
              Dr-Pete
              0
              4
              99

            • Moz site crawl showing duplicate page titles but webmaster tools doesn't
              andgee28
              andgee28
              0
              4
              130

            • Why does the moz crawl test lists page twice?
              iSTORM-New-Media
              iSTORM-New-Media
              0
              3
              224

            • Moz Crawl Test says pages have no internal links
              ChiarynMiranda
              ChiarynMiranda
              0
              4
              331

            • MOZ crawl test is not reporting on all the pages on my site.
              Abe_Schmidt
              Abe_Schmidt
              0
              2
              101

            • How do you stop Moz crawling a page?
              signcreator
              signcreator
              0
              6
              2.5k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy