The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Block Googlebot from submit button

    Block Googlebot from submit button

    Intermediate & Advanced SEO
    5 4 1.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Olivier_Lambert
      Olivier_Lambert last edited by

      Hi,

      I have a website where many searches are made by the googlebot on our internal engine. We can make noindex on result page, but we want to stop the bot to call the ajax search button - GET form (because it pass a request to an external API with associate fees).

      So, we want to stop crawling the form button, without noindex the search page itself. The "nofollow" tag don't seems to apply on button's submit.

      Any suggestion?

      1 Reply Last reply Reply Quote 0
      • crackingmedia
        crackingmedia last edited by

        Hi Bernard

        Are you able to provide a link to the web form containing the submit button?

        Peter

        Olivier_Lambert 1 Reply Last reply Reply Quote 0
        • GPainter
          GPainter last edited by

          Can always do it in a programme the bot's can't use or hide it behind a log in field etc.

          I also give you the following for consumption :

          http://moz.com/blog/12-ways-to-keep-your-content-hidden-from-the-search-engines

          Good luck!

          1 Reply Last reply Reply Quote 0
          • Olivier_Lambert
            Olivier_Lambert @crackingmedia last edited by

            http://varvacations.com/

            1 Reply Last reply Reply Quote 0
            • iPullRank
              iPullRank last edited by

              Hey Olivier,

              You could detect the user agent and hide the button. The difference isn't substantial enough to be called cloaking.

              Or you could make the button not actually a button tag, but another tag with that traps clicks with a JS event. I'm not sure Google's headless browser is smart enough to automate that. I would try this first and if it doesn't work switch to the user agent detection idea.

              Let us know how it goes!

              -Mike

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • How Submit to different Countries
                gfiorelli1
                gfiorelli1
                0
                3
                113

              • Mobile Googlebot vs Desktop Googlebot - GWT reports - Crawl errors
                iPullRank
                iPullRank
                0
                3
                832

              • I've submitted a disavow file in my www version account, should I submit one in my non-www version account as well?
                MonicaOConnor
                MonicaOConnor
                0
                3
                108

              • Blocked from google
                zeepartner
                zeepartner
                0
                4
                101

              • Manipulate Googlebot
                Igal_Zeifman
                Igal_Zeifman
                1
                3
                606

              • How to Block Google Preview?
                TakeshiYoung
                TakeshiYoung
                0
                2
                534

              • Fetch as Googlebot
                KeriMorgret
                KeriMorgret
                0
                6
                1.2k

              • Should I robots block this directory?
                irvingw
                irvingw
                0
                3
                666

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy