The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Feature Requests
    4. Meta Noindex report: exclude urls and delete all warnings in once

    Meta Noindex report: exclude urls and delete all warnings in once

    Feature Requests
    2 2 158
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • bettingfans.com
      bettingfans.com last edited by

      Dear community,

      I have a question about "Site Crawl" > "Crawler Warnings" > "Meta Noindex" reports. I see 3.6K errors with all the same url base: /register?url={{xxxxxxxx}}

      The page have the following robots meta tag: 1. Can i exclude some urls from crawling by moz-spider bot? If yes, how? 
      2. Can i use the 'mark as fixed' or 'ignore' functionality for all urls in once? Now, i have to execute the action 36 times to 'ignore' all 3600 errors.

      Hope, someone can help me 🙂

      1 Reply Last reply Reply Quote 0
      • Xiano
        Xiano last edited by

        Hi,

        1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot 
        You need to use your robots.txt file, rather than trying to do it on page

        2. Once you've done the above, you can request a recrawl and they should all disappear

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Are Monthly-Run custom reports supposed to compare against the previous month?
          bizmarquee
          bizmarquee
          0
          3
          50

        • In custom reports, Can we get a module for finished tasks?
          WebMarkets
          WebMarkets
          1
          3
          46

        • Is there a way to turn off Meta Noindex warnings?
          ChiarynMiranda
          ChiarynMiranda
          1
          5
          320

        • Discrepancy in "np" within in my Moz Report?
          LoganRay
          LoganRay
          0
          4
          119

        • RE: Custom Report Notices - "To make changes to this report, simply edit your report settings."
          dcmike
          dcmike
          0
          7
          216

        • Is it possible to set up a custom report template to use on multiple campaigns?
          2MSens
          2MSens
          1
          3
          140

        • Can Moz Reports Data be exported in Excel
          Jacky.Bizcover
          Jacky.Bizcover
          0
          3
          903

        • Competitor changed URL. What data do I lose if I update Moz settings?
          justin-brock
          justin-brock
          0
          5
          111

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy