The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. When you add 10.000 pages that have no real intention to rank in the SERP, should you: "follow,noindex" or disallow the whole directory through robots? What is your opinion?

    When you add 10.000 pages that have no real intention to rank in the SERP, should you: "follow,noindex" or disallow the whole directory through robots? What is your opinion?

    Intermediate & Advanced SEO
    6 4 101
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Zanox
      Zanox last edited by

      I just want a second opinion 🙂

      The customer don't want to loose any internal linkvalue by vaporizing link value though a big amount of internal links. What would  you do?

      1 Reply Last reply Reply Quote 0
      • FedeEinhorn
        FedeEinhorn last edited by

        What do they have? 10,000 pages of uninteresting content? a robots tag noindex,follow will do to leave them our of engines. But to decide you really need to know what those pages have. 10,000 isn't a few, and if there's value content worth sharing, a page could get a link, that if you disallow it through the robots, won't even flow pagerank.

        It all comes down to what are those pages for...?

        Zanox 1 Reply Last reply Reply Quote 1
        • customerparadigm.com
          customerparadigm.com last edited by

          Wesley - I do agree with Federico.

          That said, if they really don't want those pages indexed, use the belt-and-suspender method (if you wear both a belt and suspenders, chances are greater that your pants won't fall down).

          I'd put a robot.txt file to disallow the indexing of the directory, and also no-index / no-follow each of the pages, too.

          That way when they have someone working on the pages in the site and they change things to followed, you're still covered.  Likewise, if someone blows away the robot.txt file.

          Just my $0.02, but hope it helps…
          -- Jeff

          ChristopherGlaeser Zanox 2 Replies Last reply Reply Quote 2
          • ChristopherGlaeser
            ChristopherGlaeser @customerparadigm.com last edited by

            Yep, I agree with belt and suspenders.

            1 Reply Last reply Reply Quote 0
            • Zanox
              Zanox @FedeEinhorn last edited by

              Hi Federico,

              In this case it's an affiliate website and the 10.000 pages are all prodcutpages. It's all coming from datafeeds so it's duplicate content.

              We don't want to index this that's for sure.

              So noindex,follow or disallow the whole directory or both...

              We have our own opinion about this but I want to hear what others are thinking about this 🙂

              Thanks in advanced!

              1 Reply Last reply Reply Quote 0
              • Zanox
                Zanox @customerparadigm.com last edited by

                Hi Jeff,

                Thanks for your answer. Please take a look to the reply above on Fredrico 🙂

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • To noindex and follow or noindex no follow?
                  Gyorgy.B
                  Gyorgy.B
                  0
                  4
                  199

                • The "webmaster" disallowed all ROBOTS to fight spam! Help!!
                  JoshuaLindley
                  JoshuaLindley
                  0
                  5
                  172

                • "noindex, follow" or "robots.txt" for thin content pages
                  khi5
                  khi5
                  0
                  6
                  1.5k

                • Value in adding rel=next prev when page 2-n are "noindex, follow"?
                  Ray-pp
                  Ray-pp
                  0
                  2
                  76

                • Will disallowing in robots.txt noindex a page?
                  FranckNlemba
                  FranckNlemba
                  0
                  6
                  510

                • Manage Ranking for " Out of Stock" pages
                  RuchiPardal
                  RuchiPardal
                  0
                  5
                  402

                • My Ranking report says my site ranks 10 for keyword "Broadway Tickets' but check my rank in Google it does not even show up rank 70, why is it so ?
                  KeriMorgret
                  KeriMorgret
                  0
                  5
                  488

                • 10,000 New Pages of New Content - Should I Block in Robots.txt?
                  EGOL
                  EGOL
                  0
                  2
                  709

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy