The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Meta robots or robot.txt file?

    Meta robots or robot.txt file?

    Intermediate & Advanced SEO
    5 3 152
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • eLab_London
      eLab_London last edited by

      Hi Mozzers!

      For parametric URL's would you recommend meta robot or robot.txt file?
      For example: http://www.exmaple.com//category/product/cat no./quickView I want to stop indexing /quickView URLs.

      And what's the real difference between the two?

      Thanks again!

      Kay

      1 Reply Last reply Reply Quote 0
      • WeAreDigital_BE
        WeAreDigital_BE last edited by

        Hi There,

        I'm sure this interesting article will help you!

        Sander

        1 Reply Last reply Reply Quote 1
        • Andy.Drinkwater
          Andy.Drinkwater last edited by

          Hi Kay,

          If you want to disallow access to a page, then add the following to the Robots.txt file:

          Disallow: /quickView

          Then test this in Webmaster Tools.

          If you want to tell Google not to index a page, then you need to do this at the page level using Meta Robots. However, don't do both (at least not at the same time). If you disallow access to a set of pages via Robots.txt and then at a later stage you Meta Noindex, Google won't see this because of the Disallow in the Robots.txt.

          It really depends what you are trying to achieve, but it sounds like the Meta Robots is the way to go for you.

          -Edit... here is an interesting read for you.

          -Andy

          eLab_London 1 Reply Last reply Reply Quote 3
          • eLab_London
            eLab_London @Andy.Drinkwater last edited by

            Thanks Andy!!! 😄

            Andy.Drinkwater 1 Reply Last reply Reply Quote 0
            • Andy.Drinkwater
              Andy.Drinkwater @eLab_London last edited by

              No problem at all 🙂

              -Andy

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Set Robots.txt file to crawl my website at specific times
                Tenlo
                Tenlo
                0
                2
                50

              • If my website do not have a robot.txt file, does it hurt my website ranking?
                Alick300
                Alick300
                0
                2
                242

              • Not sure how we're blocking homepage in robots.txt; meta description not shown
                Saijo.George
                Saijo.George
                0
                5
                434

              • Our parent company has included their sitemap links in our robots.txt file - will that have an impact on the way our site is crawled?
                GlobeRunner
                GlobeRunner
                0
                2
                197

              • Issue with Robots.txt file blocking meta description
                ThompsonPaul
                ThompsonPaul
                0
                9
                3.8k

              • What should I block with a robots.txt file?
                Travis-W
                Travis-W
                1
                3
                298

              • Robots.txt file - How to block thosands of pages when you don't have a folder path
                Klarke
                Klarke
                0
                4
                264

              • Negative impact on crawling after upload robots.txt file on HTTPS pages
                ShaMenz
                ShaMenz
                0
                2
                892

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy