The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Disallow my store in robots.txt?

    Disallow my store in robots.txt?

    Intermediate & Advanced SEO
    2 2 308
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • raywhite
      raywhite last edited by

      Should I disallow my store directory in robots.txt?

      Here is the URL: https://www.stdtime.com/store/

      Here are my reasons for suggesting this:

      1. SEOMOZ finds crawl "errors" in there that I don't care about
      2. I don't think I care if the search engines index those pages
      3. I only have one product, and it is not an impulse buy
      4. My product has a 60 day sales cycle, so price is less important than features
      1 Reply Last reply Reply Quote 0
      • AlanMosley
        AlanMosley last edited by

        You seem to have evaluated things well, i will give you one reason why yopu should not, links pointing to the non indexed pages will be pouring their link juice away. , you are better off using a no-index,follow meta tag, at least then the link juice will flow back out of the links when followed.

        Robots text is a nasty tool to use, you need a more surgical approch

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Robots.txt was set to disallow for 14 days
          jc4254
          jc4254
          0
          3
          58

        • Robots.txt & Disallow: /*? Question!
          BabaBha0173
          BabaBha0173
          0
          8
          321

        • What does Disallow: /french-wines/?* actually do - robots.txt
          LoganRay
          LoganRay
          0
          8
          558

        • Robots.txt Disallowed Pages and Still Indexed
          Igor.Go
          Igor.Go
          0
          3
          2.9k

        • Robots.txt, Disallow & Indexed-Pages..
          thekiller99
          thekiller99
          0
          5
          341

        • Should I use meta noindex and robots.txt disallow?
          ntcma
          ntcma
          0
          5
          923

        • Will disallowing in robots.txt noindex a page?
          FranckNlemba
          FranckNlemba
          0
          6
          510

        • How to Disallow Tag Pages With Robot.txt
          monster99
          monster99
          0
          6
          4.0k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy