The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. How can I clean up my crawl report from duplicate records?

    How can I clean up my crawl report from duplicate records?

    Moz Tools
    2 2 961
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • RyanKent
      RyanKent last edited by

      I am viewing my Crawl Diagnostics Report.

      My report is filled with data which really shouldn't be there. For example I have a page:

      http://www.terapvp.com/forums/Ghost/

      This is a main forum page. It contains a list of many threads. The list can be sorted on many values. The page is canonicalized, and has been since it was created.

      My crawl report shows this page listed 15 times.

      http://www.terapvp.com/forums/Ghost/?direction=asc

      http://www.terapvp.com/forums/Ghost/?direction=desc

      http://www.terapvp.com/forums/Ghost/?order=post_date

      and so forth. Each of those pages uses the same canonicalization reference shared above.

      I have three questions:

      • Why is this data appearing in my crawl report? These pages are properly canonicalized.

      • If these pages are supposed to appear in the report for some reason, how can I remove them? My desire is to focus on any pages which may have an issue which needs to be addressed.

      This site has about 50 forum pages and when you add an extra 15 pages per forum, it becomes a lot harder to locate actionable data. To make matters worse, these forum indexes often have many pages. So if I have a "Corvette" forum there that is 10 pages long, then there will be 150 extra pages just for that particular forum in my crawl report.

      • Is there anything I am missing? To the best of my knowledge everything is set up according to the best SEO practices. If there is any other opinions, I would like to hear them.
      1 Reply Last reply Reply Quote 0
      • Guest
        Guest last edited by

        This post is deleted!
        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Site Not Indexing & SEOMoz Reporting ZERO On-Page Report Crawls
          Peterli
          Peterli
          0
          2
          116

        • After I make corrections of my crawl diagnostics report, how can I tell is those corrections "took". Is there a way to immediatly refresh that report. Will it eventually refresh?'
          Brian-H
          Brian-H
          0
          3
          200

        • I want to create a report of only de duplicate content pages as a csv file so i can create a script to canonicalize them.
          jdclerck
          jdclerck
          0
          7
          290

        • Crawl reports urls with duplicate content but its not the case
          Cyrus-Shepard
          Cyrus-Shepard
          0
          6
          543

        • I have another Duplicate page content Question to ask.Why does my blog tags come up as duplicates when my page gets crawled,how do I fix it?
          PCTechGuy2012
          PCTechGuy2012
          0
          4
          515

        • I put a crawl on my site via seomoz and has come back saying only 1 page has been crawled.It has been over a week now can anyone help?
          jaytwotwenty
          jaytwotwenty
          0
          3
          739

        • My website has 18500 pages but my SEO MOZ campaign is limited to a 10,000 page crawl. How can I get the other 8500 pages crawled? Can I use one of my 3 spare campaigns?
          kenneth_martin
          kenneth_martin
          0
          5
          1.0k

        • How do I get my crawl report?
          Getz.pro
          Getz.pro
          0
          3
          676

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy