The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Duplicate page found with MOZ crawl test?

    Duplicate page found with MOZ crawl test?

    Other Research Tools
    4 3 292
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • rhondafranklin
      rhondafranklin last edited by

      When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page:

      http://www.radiantguard.com and http://www.radiantguard.com/

      Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND

      is this because of how my rel canonical is set up?

      1 Reply Last reply Reply Quote 0
      • RyanPurkey
        RyanPurkey last edited by

        Hi Rhonda. Google has a nice article on this very subject here: https://webmasters.googleblog.com/2010/04/to-slash-or-not-to-slash.html The main point is that it's a best practice to choose one or the other format for your locations.  From the article:

        You can do a quick check on your site to see if the URLs:
        http://<your-domain-here>/<some-directory-here>/
        (with trailing slash)
        http://<your-domain-here>/ <some-directory-here>(no trailing slash)
        don’t both return a 200 response code, but that one version redirects to the other.</some-directory-here></your-domain-here></some-directory-here></your-domain-here>

        If only one version can be returned (i.e., the other redirects to it), that’s great! This behavior is beneficial because it reduces duplicate content. In the particular case of redirects to trailing slash URLs, our search results will likely show the version of the URL with the 200 response code (most often the trailing slash URL) -- regardless of whether the redirect was a 301 or 302.

        A 301 redirect is best as it should be the permanent structure of your site moving forward.  Cheers!

        1 Reply Last reply Reply Quote 1
        • ChiarynMiranda
          ChiarynMiranda last edited by

          Hey Rhonda,

          I took a look at your crawl test and I don't see that we are reporting any duplicate pages for http://www.radiantguard.com or http://www.radiantguard.com/. We are actually reporting that http://www.radiantguard.com/ is the canonical tag of http://www.radiantguard.com and we would never report a page as a duplicate of the canonical tag. We do consider these two pages as separate pages, as many sites do also treat them differently, so we try to encompass the most sites with the way we report on pages with trailing slashes.

          You may still want to consider Ryan's advice regarding how to deal with these two pages, however, I just wanted to clarify that we are not reporting any duplicates on either pages. Here is a screenshot of the CSV that shows that these pages have no reported duplicates: http://www.screencast.com/t/5FHTfyQe

          I hope that helps to clear things up a bit, but please do let me know if you have more questions about the crawl report.

          1 Reply Last reply Reply Quote 2
          • rhondafranklin
            rhondafranklin last edited by

            Thanks Ryan and Chiaryn!  All looks good then!  So happy 🙂

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Need help fixing a duplicate content issue for my website. The moz crawl is show OMG my website with https:// and https://www. But I have never used the url https:// so I don’t understand why moz is showing this
              RossKernez
              RossKernez
              0
              4
              58

            • Moz is only crawling 2 pages
              mvnmarketing
              mvnmarketing
              0
              5
              91

            • Why is Moz Crawling More Pages Than My Site Actually Has?
              tawnycase
              tawnycase
              0
              2
              60

            • How can I find duplicate pages from a Moz Crawl?
              expmission
              expmission
              0
              3
              291

            • Duplicate Home Page in Moz Report
              gymmad
              gymmad
              0
              3
              79

            • Moz crawl issues: All pages keep resolving to our "cookies not enabled" page
              edwardpconway
              edwardpconway
              0
              4
              109

            • MOZ crawl test is not reporting on all the pages on my site.
              Abe_Schmidt
              Abe_Schmidt
              0
              2
              101

            • Moz not crawling opencart product pages
              RuthBurrReedy
              RuthBurrReedy
              0
              6
              432

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy