The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Web Design
    4. Search directory - How to apply robots

    Search directory - How to apply robots

    Web Design
    3 2 276
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Blenny
      Blenny last edited by

      Hi.

      On the site I'm working on, we use a search directory to display our search results. It displays as follows -

      Mydomain.com/search-results/#

      With the dynamic search results appearing after the hash tag.

      Because of the structure of the website, many of the lefthand nav defers back to this directory. I know that most websites "noindex, nofollow" the search results pages, but due to the ease of customers generating them, I'm afraid that if I do this, we'll miss out on the inevitable links customers will provide...and, even though it's just the main search directory, these links will still help my domain. The search is all java-generated so there's nothing for spiders to follow within this directory - save the standard category nav.

      How should I handle this?

      Thanks.

      1 Reply Last reply Reply Quote 0
      • jeffreytrull1
        jeffreytrull1 last edited by

        Have you considered switching to simply "noindex, follow" for these pages? This would both keep them out of the search index and would allow for the benefit of external links to these pages.

        Blenny 1 Reply Last reply Reply Quote 1
        • Blenny
          Blenny @jeffreytrull1 last edited by

          That was my first instinct as well - but I wanted to check if there was a better move? Thanks for your help!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Google Search Console Block
            BoostMyBiz
            BoostMyBiz
            0
            7
            125

          • Build a Directory
            BenjaminMorel
            BenjaminMorel
            0
            3
            115

          • Robots.txt - Allow and Disallow. Can they be the same?
            eventurerob
            eventurerob
            0
            9
            801

          • How to fix and issue with robot.txt ?
            Matt-Williamson
            Matt-Williamson
            0
            7
            4.0k

          • My personal search page
            AndySolo
            AndySolo
            0
            5
            376

          • Link Pages/Directory
            waqid
            waqid
            0
            2
            424

          • Page Title or Search Friendly Urls?
            RyanKent
            RyanKent
            0
            2
            761

          • Need advice on diplaying content for Search
            tgraham
            tgraham
            0
            3
            1.1k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy