The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. MOZ crawl report says category pages blocked by meta robots but theyr'e not?

    MOZ crawl report says category pages blocked by meta robots but theyr'e not?

    Intermediate & Advanced SEO
    5 3 315
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SamCUK
      SamCUK last edited by

      I've just run a SEOMOZ crawl report and it tells me that the category pages on my site such as http://www.top-10-dating-reviews.com/category/online-dating/ are blocked by meta robots and have the meta robots tag noindex,follow.

      This was the case a couple of days ago as I run wordpress and am using the SEO Category updater plugin. By default it appears it makes categories noindex, follow. Therefore I edited the plugin so that the default was index, follow as I want google to index the category pages so that I can build links to them.

      When I open the page in a browser and view source the tags show as index, follow which adds up. Why then is the SEOMOZ report telling me they are still noindex,follow?

      Presumably the crawl is in real time and should pick up the new follow tag or is it perhaps because its using data from an old crawl?

      As yet these pages aren't indexed by google.

      Any help is much appreciated!

      Thanks

      Sam.

      1 Reply Last reply Reply Quote 0
      • Andropenis_Australia
        Andropenis_Australia last edited by

        And is your robots.txt file inline with the on page directives?

        If all is good I would just put it down to a moz error, sometimes you just need to be aware of the issues and warnings rather than act on them.

        All the best 🙂

        SamCUK 1 Reply Last reply Reply Quote 0
        • SamCUK
          SamCUK @Andropenis_Australia last edited by

          Thanks for your reply. The Robots.txt reads:

          User-agent: *Disallow: /wp-admin/Disallow: /wp-includes/ Sitemap: http://www.top-10-dating-reviews.com/sitemap.xml.gz

          As fas as I'm aware this is okay?

          Sam.

          1 Reply Last reply Reply Quote 0
          • MeganSingley
            MeganSingley last edited by

            Hi Sam! This is Megan from SEOmoz. I've had our engineers take a look at your campaign and everything looks good now. Do you know if you made any changes today that would fix the 'blocked by meta robots' issue? Your next crawl that comes through should reflect the new information - showing the previously blocked URLs as "index, follow". If you're still running in to any problems, feel free to shoot us a message to help@seomoz.org and we'll check it out!

            Cheers!

            SamCUK 1 Reply Last reply Reply Quote 1
            • SamCUK
              SamCUK @MeganSingley last edited by

              Hi Megan,

              Thanks for your reply. I'll run a crawl now and hopefully all will be okay.

              Sam.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Pages blocked by robots
                mihoreis
                mihoreis
                0
                3
                69

              • Scary bug in search console: All our pages reported as being blocked by robots.txt after https migration
                Christy-Correll
                Christy-Correll
                0
                6
                94

              • My crawl can't find ANY product pages. The links to product pages aren't links, they're script. :(
                Joe.Robison
                Joe.Robison
                0
                8
                247

              • Search engine blocked by robots-crawl error by moz & GWT
                RuthBurrReedy
                RuthBurrReedy
                0
                11
                445

              • Duplicate Page Content Issues Reported in Moz Crawl Report
                dan.lecocq
                dan.lecocq
                0
                2
                253

              • My warning report says I have too many on page links - 517! I can't find 50% of them but my q is about no follow
                Horizon
                Horizon
                0
                3
                196

              • Old pages still crawled by SE returning 404s. Better to put 301 or block with robots.txt ?
                RyanKent
                RyanKent
                0
                2
                721

              • Robots.txt: Link Juice vs. Crawl Budget vs. Content 'Depth'
                rishil
                rishil
                0
                5
                1.5k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy