The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?

    Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?

    On-Page / Site Optimization
    9 6 183
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mac2233
      mac2233 last edited by

      While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,

      A description for this result is not avaliable because of this site's robot.s.txt

      The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.

      Anyone else had this happen and have a fix?

      1 Reply Last reply Reply Quote 0
      • gazzerman1
        gazzerman1 last edited by

        Can you check something for me please?

        Log in to wp-admin

        Go to Setting then Privacy

        Check if “Ask search engines not to index this site.” is set to ON

        mac2233 1 Reply Last reply Reply Quote 0
        • AndrewClark
          AndrewClark last edited by

          I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.

          mac2233 1 Reply Last reply Reply Quote 0
          • mac2233
            mac2233 @AndrewClark last edited by

            It's pretty standard

            User-agent: *

            Disallow: /wp-admin/

            Disallow: /wp-includes/
            
            AndrewClark 1 Reply Last reply Reply Quote 0
            • mac2233
              mac2233 @gazzerman1 last edited by

              No, it's not on. The site is indexed, just certain description tags aren't.

              1 Reply Last reply Reply Quote 0
              • AndrewClark
                AndrewClark @mac2233 last edited by

                Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.

                Would you be willing to share the URL?

                1 Reply Last reply Reply Quote 0
                • Milian
                  Milian last edited by

                  Could the pages have been blocked in robotos.txt in the past?  It can take an age for Google to re-index pages a proper after having been blocked previously.

                  1 Reply Last reply Reply Quote 0
                  • Christy-Correll
                    Christy-Correll last edited by

                    Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)

                    1 Reply Last reply Reply Quote 0
                    • DavidFaltz
                      DavidFaltz last edited by

                      I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.

                      1 Reply Last reply Reply Quote 0
                      • 1 / 1
                      • First post
                        Last post
                      • My website isn't showing on releated: google command
                        dos0659
                        dos0659
                        0
                        3
                        60

                      • Old DMOZ description showing up in SERP meta description.
                        JordanLowry
                        JordanLowry
                        0
                        6
                        65

                      • Web designer doesn't see duplicate pages or issues??? Help!
                        ThomasHarvey
                        ThomasHarvey
                        0
                        6
                        107

                      • Does name of town in title tag help if queries don't include the town name?
                        Morris77
                        Morris77
                        0
                        9
                        412

                      • I've just manually edited all the page titles and meta descriptions on a site, when will this show in Google results?
                        donford
                        donford
                        0
                        3
                        90

                      • Why isn't our site being shown on the first page of Google for a query using the exact domain, when its pages are indeed indexed by Google
                        featherseo
                        featherseo
                        0
                        3
                        144

                      • Pages that show in Open Site Explorer that show as 404's in search
                        RyanKent
                        RyanKent
                        0
                        4
                        526

                      • Advice on why page isn't being indexed in google top 1000 for keyword
                        RyanKent
                        RyanKent
                        0
                        6
                        699

                      Get started with Moz Pro!

                      Unlock the power of advanced SEO tools and data-driven insights.

                      Start my free trial
                      Products
                      • Moz Pro
                      • Moz Local
                      • Moz API
                      • Moz Data
                      • STAT
                      • Product Updates
                      Moz Solutions
                      • SMB Solutions
                      • Agency Solutions
                      • Enterprise Solutions
                      • Digital Marketers
                      Free SEO Tools
                      • Domain Authority Checker
                      • Link Explorer
                      • Keyword Explorer
                      • Competitive Research
                      • Brand Authority Checker
                      • Local Citation Checker
                      • MozBar Extension
                      • MozCast
                      Resources
                      • Blog
                      • SEO Learning Center
                      • Help Hub
                      • Beginner's Guide to SEO
                      • How-to Guides
                      • Moz Academy
                      • API Docs
                      About Moz
                      • About
                      • Team
                      • Careers
                      • Contact
                      Why Moz
                      • Case Studies
                      • Testimonials
                      Get Involved
                      • Become an Affiliate
                      • MozCon
                      • Webinars
                      • Practical Marketer Series
                      • MozPod
                      Connect with us

                      Contact the Help team

                      Join our newsletter
                      Moz logo
                      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                      • Accessibility
                      • Terms of Use
                      • Privacy