The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. How to enable crawling for dynamic generated search result pages?

    How to enable crawling for dynamic generated search result pages?

    Intermediate & Advanced SEO
    2 2 766
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CommercePundit
      CommercePundit last edited by

      I want to enable crawling facility for dynamic generated search result pages which are generating by Magento Solr search. You can view more about it by following URLs.

      http://code.google.com/p/magento-solr/

      http://www.vistastores.com/catalogsearch/result/?q=bamboo+table+lamp
      http://www.vistastores.com/catalogsearch/result/?q=ceramic+table+lamp
      http://www.vistastores.com/catalogsearch/result/?q=green+patio+umbrella

      Right now, Google is not crawling search result page because, I have added following syntax to Robots.txt file.

      Disallow: /*?q=

      So, How do I enable crawling of search result pages with best SEO practice? If any other inputs in same direction so, it will help me more to get it done.

      1 Reply Last reply Reply Quote 0
      • Mikpam
        Mikpam last edited by

        Sorry to answer a question with another question, why would you like your search results to get crawled or indexed? If I remember right back in 2007 Google put up filters for this due to the prominence of search results from the big shopping sites like amazon and bizrate serving up search pages and dominating the 1st page of queries like dvd players etc.

        The use of robots.txt to prevent crawling of search results pages or other auto-generated pages that don’t add much value for users coming from search engines is highly recommended. I would go with this unless you have a reason to serve these results. Hope this helps

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Blocking Dynamic Search Result Pages From Google
          badgergravling
          badgergravling
          0
          2
          52

        • 301 redirect to search results page?
          OlegKorneitchouk
          OlegKorneitchouk
          0
          2
          136

        • Canonical URL on search result pages
          9868john
          9868john
          0
          3
          186

        • An improved search box within the search results - Results?
          DennisSeymour
          DennisSeymour
          0
          2
          91

        • Top Google News Result = Search Result #11 (first on second page)
          dangaul
          dangaul
          0
          3
          407

        • Help! Optimizing dynamic internal search results pages...
          Keszi
          Keszi
          0
          4
          639

        • We are changing ?page= dynamic url's to /page/ static urls. Will this hurt the progress we have made with the pages using dynamic addresses?
          h3counsel
          h3counsel
          0
          3
          806

        • Dynamically generated page issues
          perfectweb
          perfectweb
          0
          8
          1.3k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy