The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?

    The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?

    Moz Tools
    2 2 210
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • trixmediainc
      trixmediainc last edited by

      When we marked a page as noindex with robots like

      {<meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">noindex</a>" />}

      will crawl and marked as duplicate page content(Its already a duplicate page content within the site. ie, Two links pointing to the same page).So we are mentioning both the links no need to index on SE.But after we made this and crawl reports have no change like it tooks the duplicate with noindex marked pages too.

      Please help to solve this problem.

      1 Reply Last reply Reply Quote 0
      • DougRoberts
        DougRoberts last edited by

        What you're seeing is normal. What you want to check is that the number of pages is the number you expect.

        From the SEOMoz FAQ on the Crawl Report:

        We are still seeing duplicate content on SEOmoz even though we have marked those pages as "noindex, follow." Any ideas why?
        SEOMoz is not a search engine index, it uses a crawler. If those pages are not blocked by the robots.txt file, then SEOMoz will crawl them. They ignore the noindex tag because they don't index anything. Search engines will honor the noindex tag and not index a page if you specify with the robots meta tag. However, to remove pages from the crawl, disallow them in the robots.txt or metarobots.

        (http://www.seomoz.org/help/crawl-diagnostics)

        Hope this helps.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Should I set blog category/tag pages as "noindex"? If so, how do I prevent "meta noindex" Moz crawl errors for those pages?
          LoganRay
          LoganRay
          0
          6
          5.1k

        • Pages with Duplicate Page Content Nov
          TheSymmetran
          TheSymmetran
          0
          2
          94

        • Moz is treating my pages as duplicate content but the pages have different content in reality
          clestcruz
          clestcruz
          0
          3
          168

        • Block Moz (or any other robot) from crawling pages with specific URLs
          Blacktie
          Blacktie
          0
          3
          844

        • Since July 1, we've had a HUGE jump in errors on our weekly crawl. We don't think anything has changed on our website. Has MOZ changed something that would account for a large leap in duplicate content and duplicate title errors?
          KristyFord
          KristyFord
          0
          3
          77

        • Will moz crawl pages blocked by robots.txt and nofollow links?
          Ryan_Watson
          Ryan_Watson
          0
          2
          184

        • Why does SEO moz show so many more duplicate page titles than webmaster
          OlegKorneitchouk
          OlegKorneitchouk
          0
          4
          363

        • How to resolve Duplicate Content crawl errors for Magento Login Page
          afmaury
          afmaury
          1
          5
          2.5k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy