The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. NOINDEX content still showing in SERPS after 2 months

    NOINDEX content still showing in SERPS after 2 months

    Intermediate & Advanced SEO
    9 4 843
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • NormanNewsome
      NormanNewsome last edited by

      I have a website that was likely hit by Panda or some other algorithm change. The hit finally occurred in September of 2011. In December my developer set the following meta tag on all pages that do not have unique content:

      name="robots" content="NOINDEX" />

      It's been 2 months now and I feel I've been patient, but Google is still showing 10,000+ pages when I do a search for site:http://www.mydomain.com

      I am looking for a quicker solution. Adding this many pages to the robots.txt does not seem like a sound option. The pages have been removed from the sitemap (for about a month now). I am trying to determine the best of the following options or find better options.

      1. 301 all the pages I want out of the index to a single URL based on the page type (location and product). The 301 worries me a bit because I'd have about 10,000 or so pages all 301ing to one or two URLs. However, I'd get some link juice to that page, right?
      2. Issue a HTTP 404 code on all the pages I want out of the index. The 404 code seems like the safest bet, but I am wondering if that will have a negative impact on my site with Google seeing 10,000+ 404 errors all of the sudden.
      3. Issue a HTTP 410 code on all pages I want out of the index. I've never used the 410 code and while most of those pages are never coming back, eventually I will bring a small percentage back online as I add fresh new content. This one scares me the most, but am interested if anyone has ever used a 410 code.

      Please advise and thanks for reading.

      1 Reply Last reply Reply Quote 0
      • EGOL
        EGOL last edited by

        I removed some pages from the index and used the same line of code...

        name="robots" content="NOINDEX" />

        My pages dropped from the index within 2 or 3 days - but this is a site that has very heavy spider activity.

        If your site is not crawled very much or these are low PR pages (such as PR1, PR2) it could take google a while to revisit and act upon your noindex instructions - but two months seems a  bit long.

        Is your site being crawled vigorously?  Look in webmaster tools to see if crawling declined abruptly when your rankings fell.  Check there also for crawl problems.

        If I owned your site and the PR of these pages is low I would wait a while longer before doing anything.  If my patience was wearing thin I would do the 301 redirect because that will transfer the linkjuice from those pages to the target URL of the redirect - however, you might wait quite a while to see the redirect take effect.  That's why my first choice would be to wait longer.

        NormanNewsome 1 Reply Last reply Reply Quote 1
        • SteveGerencser
          SteveGerencser last edited by

          If you want a page out of the index fast the best way is to do it through webmaster tools. It's easy and lasts for about six months. Then, if they find your page again it will register the noindex and you should be fine.

          As EGOL said, if it's a page that isn't crawled very often then it could be a LONG time before it gets deindexed.

          NormanNewsome 1 Reply Last reply Reply Quote 0
          • NormanNewsome
            NormanNewsome @SteveGerencser last edited by

            Yeah the pages are low PR and are not linked to at all from the site. I've never heard of removing a page via webmaster tools. How do I do that? I also have to remove several thousand.

            *edit: It looks like I have to remove them one at a time which is not feasible in my case. Is there a faster way?

            Webmaster_SEO EGOL NormanNewsome 3 Replies Last reply Reply Quote 0
            • NormanNewsome
              NormanNewsome @EGOL last edited by

              I suppose I'll wait longer. Crawl rate over the last 90 days is a high of 3,285 and average of 550 with a low of 3 according to webmaster tools.

              IZGjg.png

              1 Reply Last reply Reply Quote 0
              • Webmaster_SEO
                Webmaster_SEO @NormanNewsome last edited by

                If all these pages are under a directory structure than you have the option to remove a complete directory in URL removal option. See if that is feasible in your case.

                1 Reply Last reply Reply Quote 0
                • EGOL
                  EGOL @NormanNewsome last edited by

                  If they are not linked to then spiders will not find the noindex code.  They could suffer in the SERPs for months and months.

                  1 Reply Last reply Reply Quote 0
                  • NormanNewsome
                    NormanNewsome @NormanNewsome last edited by

                    I could link to them then, but what about creating a custom sitemap for just content that I want removed? Would that have the same effect?

                    1 Reply Last reply Reply Quote 0
                    • NormanNewsome
                      NormanNewsome last edited by

                      Just wanted to let you know that submitting all the sites I wanted removed into an XML sitemap worked. I then submitted that sitemap to webmaster tools and listed it in the robots.txt. When doing query "site:domain.com" index pages went from 20k+ down to 700 in a matter of days.

                      1 Reply Last reply Reply Quote 0
                      • 1 / 1
                      • First post
                        Last post
                      • If a website trades internationally and simply translates its online content from English to French, German, etc how can we ensure no duplicate content penalisations and still maintain SEO performance in each territory?
                        Martijn_Scheijbeler
                        Martijn_Scheijbeler
                        0
                        2
                        46

                      • Noindex Valuable duplicate content?
                        Rich_Coffman
                        Rich_Coffman
                        0
                        3
                        53

                      • "No index" page still shows in search results and paginated pages shows page 2 in results
                        khi5
                        khi5
                        0
                        3
                        114

                      • SERPS showing wrong page
                        Kurt_Steinbrueck
                        Kurt_Steinbrueck
                        0
                        2
                        125

                      • To noindex or not to noindex
                        AgentsofValue
                        AgentsofValue
                        0
                        7
                        646

                      • Duplicate blog content and NOINDEX
                        ahirai
                        ahirai
                        0
                        5
                        470

                      • Still my serps are down
                        MattJanaway
                        MattJanaway
                        0
                        19
                        1.2k

                      • Old Redirecting Website Still Showing In SERPs
                        wojkwasi
                        wojkwasi
                        1
                        3
                        612

                      Get started with Moz Pro!

                      Unlock the power of advanced SEO tools and data-driven insights.

                      Start my free trial
                      Products
                      • Moz Pro
                      • Moz Local
                      • Moz API
                      • Moz Data
                      • STAT
                      • Product Updates
                      Moz Solutions
                      • SMB Solutions
                      • Agency Solutions
                      • Enterprise Solutions
                      • Digital Marketers
                      Free SEO Tools
                      • Domain Authority Checker
                      • Link Explorer
                      • Keyword Explorer
                      • Competitive Research
                      • Brand Authority Checker
                      • Local Citation Checker
                      • MozBar Extension
                      • MozCast
                      Resources
                      • Blog
                      • SEO Learning Center
                      • Help Hub
                      • Beginner's Guide to SEO
                      • How-to Guides
                      • Moz Academy
                      • API Docs
                      About Moz
                      • About
                      • Team
                      • Careers
                      • Contact
                      Why Moz
                      • Case Studies
                      • Testimonials
                      Get Involved
                      • Become an Affiliate
                      • MozCon
                      • Webinars
                      • Practical Marketer Series
                      • MozPod
                      Connect with us

                      Contact the Help team

                      Join our newsletter
                      Moz logo
                      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                      • Accessibility
                      • Terms of Use
                      • Privacy