The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Will disallowing in robots.txt noindex a page?

    Will disallowing in robots.txt noindex a page?

    Intermediate & Advanced SEO
    6 5 510
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Brocberry
      Brocberry last edited by

      Google has indexed a page I wish to remove. I would like to meta noindex but the CMS isn't allowing me too right now. A suggestion o disallow in robots.txt would simply stop them crawling I expect or is it also an instruction to noindex? Thanks

      1 Reply Last reply Reply Quote 0
      • Unity
        Unity last edited by

        It the page has already been indexed and you block via robots.txt file what you will most likely see in SERPs is a listing with no meta description (so just one line). I do believe that ranking placements will drop. If you want to remove from SERPs completely you need to use the noindex tag.

        I would block by robots.txt file now while you work out how to add the noindex tag.

        1 Reply Last reply Reply Quote 0
        • NakulGoyal
          NakulGoyal last edited by

          You'd have to add the disallow in robots.txt and then go into the Google Webmaster Console, use the Remove URLs option to get Google to deindex that page.

          From Google:

          Use **robots.txt **to specify how search engines should crawl your site, or request **removal **of URLs from Google's search results ( have you read our removal requirements? ). Only site owners and users with full permissions can request removals.

          Zachary_Russell 1 Reply Last reply Reply Quote 2
          • Zachary_Russell
            Zachary_Russell last edited by

            Check out this article, it's the Google Requirements for Removing content

            There are multiple ways to do this:

            Ideally, robots.txt is the way to go, you can also noindex the page. There is no need to do both. If your looking for the page to disappear as well, i'd let it 404.

            Another option is to request the URL to be removal request in Google Webmaster Tools along with these things it's under optimization>Remove URLs.

            Hope this helps

            1 Reply Last reply Reply Quote 1
            • Zachary_Russell
              Zachary_Russell @NakulGoyal last edited by

              Good answer 🙂 we both submitted this at the same time.

              1 Reply Last reply Reply Quote 0
              • FranckNlemba
                FranckNlemba last edited by

                Hi

                I would also suggest to make sure to change internal links if possible and make them point to the page you want to see in the index

                1 Reply Last reply Reply Quote 1
                • 1 / 1
                • First post
                  Last post
                • Robots.txt, Disallow & Indexed-Pages..
                  thekiller99
                  thekiller99
                  0
                  5
                  341

                • Should I use meta noindex and robots.txt disallow?
                  ntcma
                  ntcma
                  0
                  5
                  923

                • "noindex, follow" or "robots.txt" for thin content pages
                  khi5
                  khi5
                  0
                  6
                  1.5k

                • Meta NoIndex tag and Robots Disallow
                  ThompsonPaul
                  ThompsonPaul
                  0
                  5
                  1.3k

                • If i disallow unfriendly URL via robots.txt, will its friendly counterpart still be indexed?
                  Cyrus-Shepard
                  Cyrus-Shepard
                  0
                  4
                  620

                • Panda Updates - robots.txt or noindex?
                  dmccarthy
                  dmccarthy
                  0
                  5
                  666

                • How to Disallow Tag Pages With Robot.txt
                  monster99
                  monster99
                  0
                  6
                  4.0k

                • Disallow my store in robots.txt?
                  AlanMosley
                  AlanMosley
                  0
                  2
                  308

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy