The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?

    The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?

    Moz Tools
    2 2 210
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • trixmediainc
      trixmediainc last edited by

      When we marked a page as noindex with robots like

      {<meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">noindex</a>" />}

      will crawl and marked as duplicate page content(Its already a duplicate page content within the site. ie, Two links pointing to the same page).So we are mentioning both the links no need to index on SE.But after we made this and crawl reports have no change like it tooks the duplicate with noindex marked pages too.

      Please help to solve this problem.

      1 Reply Last reply Reply Quote 0
      • DougRoberts
        DougRoberts last edited by

        What you're seeing is normal. What you want to check is that the number of pages is the number you expect.

        From the SEOMoz FAQ on the Crawl Report:

        We are still seeing duplicate content on SEOmoz even though we have marked those pages as "noindex, follow." Any ideas why?
        SEOMoz is not a search engine index, it uses a crawler. If those pages are not blocked by the robots.txt file, then SEOMoz will crawl them. They ignore the noindex tag because they don't index anything. Search engines will honor the noindex tag and not index a page if you specify with the robots meta tag. However, to remove pages from the crawl, disallow them in the robots.txt or metarobots.

        (http://www.seomoz.org/help/crawl-diagnostics)

        Hope this helps.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Pages with Duplicate Page Content Nov
          TheSymmetran
          TheSymmetran
          0
          2
          94

        • Moz is treating my pages as duplicate content but the pages have different content in reality
          clestcruz
          clestcruz
          0
          3
          168

        • Duplicate Content: Marketing Page / Content Page
          AllMedSeo
          AllMedSeo
          0
          3
          136

        • Seo moz has only crawled 2 pages of my site. Ive been notified of a 403 error and need an answer as to why my pages are not being crawled?
          nitro-digital
          nitro-digital
          0
          9
          319

        • Why does SEO moz show so many more duplicate page titles than webmaster
          OlegKorneitchouk
          OlegKorneitchouk
          0
          4
          363

        • How to resolve Duplicate Content crawl errors for Magento Login Page
          afmaury
          afmaury
          1
          5
          2.5k

        • "Duplicate Page Title" and "Duplicate Page Content" issue
          JoeBrewer
          JoeBrewer
          0
          3
          421

        • "Issue: Duplicate Page Content " in Crawl Diagnostics - but these pages are noindex
          AaronWheeler
          AaronWheeler
          0
          2
          1.1k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy