The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. How can I find duplicate pages from a Moz Crawl?

    How can I find duplicate pages from a Moz Crawl?

    Other Research Tools
    3 2 291
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • expmission
      expmission last edited by

      We have many duplicate pages that show up on the Moz Crawl, and we're trying to fix these but it's very difficult because I can't see a way to isolate the code where the duplicate is found. For instance, http://experiencemission.org/immersion/ is one of our main pages, and the crawl shows one duplicate of http://experiencemission.org/immersion. It appears that one of our staff manually edited the source code in one of our pages but forgot the trailing slash. This would be an easy fix but the problem is that this page is linked to internally on our website 2423 times, so it's next to impossible to find the code that is incorrect. We have many other pages with this same basic problem. We know we have duplicates, but it's next to impossible to isolate them.

      So my question is this: When viewing the Moz Crawl data is there any way to see where a specific duplicate page link is located on our website?

      Thanks for any and all help!

      1 Reply Last reply Reply Quote 0
      • Moz.HelpTeam
        Moz.HelpTeam last edited by

        Hey there! You've got a couple different options for ways to track this information down. The first would be to head into your campaign, head over to the Site Crawl and click on the link towards the bottom for Duplicate Page Content. Right below the graph you'll see a button that says Download CSV. Open that up and head on over to column AM and you'll see the referring URL! Another option is to jump into Open Site Explorer and check out the internal inbound links. Hope this helps and let us know if you need anything else!

        expmission 1 Reply Last reply Reply Quote 3
        • expmission
          expmission @Moz.HelpTeam last edited by

          Thanks for taking the time to respond. The open site explorer is helpful for issues that have a manageable number of internal links. However, for the example above and a few others like it on our website it is not that helpful because isolating the link would still require us to click on the pages individually to view the source code. This is because most of our errors are minor errors such as an omitted slash or capitalization. Such errors are flagged as duplicate content in our Moz crawl but the links still work because they redirect to the correct page and thus they are not able to be isolated on the open site explorer. Unfortunately the .csv is no help at all because it only shows the page being linked to not the page where the actual link is coming from.

          Are we just out of luck on this or is there another option?

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Moz is only crawling 2 pages
            mvnmarketing
            mvnmarketing
            0
            5
            91

          • Why is Moz Crawling More Pages Than My Site Actually Has?
            tawnycase
            tawnycase
            0
            2
            60

          • MozBot Finding Duplicate Pages That Aren't Duplicate
            tawnycase
            tawnycase
            0
            2
            54

          • Moz is finding phantom pages
            kevin.loesken
            kevin.loesken
            0
            6
            156

          • Moz crawler only crawls one page?!
            ChiarynMiranda
            ChiarynMiranda
            0
            4
            174

          • Duplicate Home Page in Moz Report
            gymmad
            gymmad
            0
            3
            79

          • In Moz Medium Pro how many pages can you track for keyword rankings at a time? I know you can track up to 50 in Standard.
            DavidLee
            DavidLee
            0
            2
            209

          • Moz crawl issues: All pages keep resolving to our "cookies not enabled" page
            edwardpconway
            edwardpconway
            0
            4
            109

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy