The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. How to 100% stop google indexing static and dynamic URLs

    How to 100% stop google indexing static and dynamic URLs

    On-Page / Site Optimization
    5 4 2.3k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mattys
      mattys last edited by

      This post is deleted!
      1 Reply Last reply Reply Quote 0
      • JamesNorquay
        JamesNorquay last edited by

        I would block it on the robots.txt file and also add the meta tag to the page but the robots txt will be the first choice.

        Another options you could look at is adding canonical tags to pages if you have duplicate content issues, great information on these tags can be found here:

        http://googlewebmastercentral.blogspot.com/2009/02/specify-your-canonical.html

        Theo-NL 1 Reply Last reply Reply Quote 0
        • RyanKent
          RyanKent last edited by

          Hi Matt.

          Robots.txt works when you are dealing with a shopping cart or CMS software which does not offer the granularity of SEO options we desire. Otherwise the best robots.txt file is a blank one.

          If you decide to use the "noindex" option that is fine, but I would recommend against using the "nofollow" tag as it will stop your PR from flowing naturally within your own site.

          From looking at your site it seems the URLs you offered are to a generic booking page with no content that exist to allow users to reserve cottages for specific dates. I don't see any value in adding this page to a search index. If you agree then the nofollow tag is your solution.

          Two additional tidbits: Lindsay wrote a nice article related to this topic that I will recommend to you: http://www.seomoz.org/blog/complete-guide-to-rel-canonical-how-to-and-why-not

          Google Webmaster Tools (and Bing) offers an option to change how they view parameters in your URL. From your dashboard > Site Configuration > URL parameters > you would click "Add parameter" then enter cottage. This is for future reference and is not necessary in this case if you properly noindex the pages.

          1 Reply Last reply Reply Quote 1
          • Theo-NL
            Theo-NL @JamesNorquay last edited by

            I would personally advice against placing the noindex in two places. Either one of the works, and adding them in two places might just confuse future developers about the reasons behind the double noindex.

            JamesNorquay 1 Reply Last reply Reply Quote 0
            • JamesNorquay
              JamesNorquay @Theo-NL last edited by

              Hence why I said adding the robots.txt block would be the first choice.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Strange google indexing behaviour
                WonkyDog
                WonkyDog
                0
                3
                104

              • Indexed/Submitted URLS vs Total Indexed
                BlueprintMarketing
                BlueprintMarketing
                0
                2
                248

              • When You Add a Robots.txt file to a website to block certain URLs, do they disappear from Google's index?
                Saijo.George
                Saijo.George
                0
                3
                205

              • Google Index HTTPS
                JohnHuynh
                JohnHuynh
                0
                3
                105

              • What are the best practices for google indexing ajax response urls?
                DoRM
                DoRM
                0
                3
                259

              • How long for Google to re-index
                RobMay
                RobMay
                0
                8
                4.2k

              • ON SITE SEARCH INDEXED BY GOOGLE - no follow or no index
                ShaMenz
                ShaMenz
                0
                4
                770

              • How long after a URL starts showing a 404 does Google stop crawling?
                AndrewMiller
                AndrewMiller
                0
                4
                590

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy