The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?

    The pages that add robots as noindex will Crawl and marked as duplicate page content on seo moz ?

    Moz Tools
    2 2 210
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • trixmediainc
      trixmediainc last edited by

      When we marked a page as noindex with robots like

      {<meta name="<a class="attribute-value">robots</a>" content="<a class="attribute-value">noindex</a>" />}

      will crawl and marked as duplicate page content(Its already a duplicate page content within the site. ie, Two links pointing to the same page).So we are mentioning both the links no need to index on SE.But after we made this and crawl reports have no change like it tooks the duplicate with noindex marked pages too.

      Please help to solve this problem.

      1 Reply Last reply Reply Quote 0
      • DougRoberts
        DougRoberts last edited by

        What you're seeing is normal. What you want to check is that the number of pages is the number you expect.

        From the SEOMoz FAQ on the Crawl Report:

        We are still seeing duplicate content on SEOmoz even though we have marked those pages as "noindex, follow." Any ideas why?
        SEOMoz is not a search engine index, it uses a crawler. If those pages are not blocked by the robots.txt file, then SEOMoz will crawl them. They ignore the noindex tag because they don't index anything. Search engines will honor the noindex tag and not index a page if you specify with the robots meta tag. However, to remove pages from the crawl, disallow them in the robots.txt or metarobots.

        (http://www.seomoz.org/help/crawl-diagnostics)

        Hope this helps.

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Should I set blog category/tag pages as "noindex"? If so, how do I prevent "meta noindex" Moz crawl errors for those pages?
          LoganRay
          LoganRay
          0
          6
          5.1k

        • Duplicate content flagged by Moz that's not actually duplicate content at all
          Caro-O
          Caro-O
          1
          4
          89

        • Duplicate Content: Marketing Page / Content Page
          AllMedSeo
          AllMedSeo
          0
          3
          136

        • Block Moz (or any other robot) from crawling pages with specific URLs
          Blacktie
          Blacktie
          0
          3
          844

        • Crawl report - duplicate page title/content issue
          SEOAndy
          SEOAndy
          0
          4
          203

        • Why does SEO moz show so many more duplicate page titles than webmaster
          OlegKorneitchouk
          OlegKorneitchouk
          0
          4
          363

        • I have another Duplicate page content Question to ask.Why does my blog tags come up as duplicates when my page gets crawled,how do I fix it?
          PCTechGuy2012
          PCTechGuy2012
          0
          4
          515

        • "Issue: Duplicate Page Content " in Crawl Diagnostics - but these pages are noindex
          AaronWheeler
          AaronWheeler
          0
          2
          1.1k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy