The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How to disallow google and roger?

    How to disallow google and roger?

    Technical SEO Issues
    2 2 729
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • iFix
      iFix last edited by

      Hey Guys and girls,

      i have a question, i want to disallow all robots from accessing a certain root link:

      Get rid of bots

      User-agent: *

      Disallow: /index.php?_a=login&redir=/index.php?_a=tellafriend%26productId=*

      Will this make the bots not to access any web link that has the prefix you see before the asterisk? And at least google and roger will get away by reading "user-agent: *"? I know this isn't the standard proceedure but if it works for google and seomoz bot we are good.

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        In short, yes that will work.

        To be clear, you can have multiple links which all lead to the same target page. The target of that link could still be indexed if there are other unblocked links which point to it.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • What's going on with google index - javascript and google bot
          Everett
          Everett
          0
          4
          475

        • Disallow statement - is this tiny anomaly enough to render Disallow invalid?
          lzhao
          lzhao
          0
          3
          118

        • Google index graph duration in Google Webmaster Tools
          ecommercebc
          ecommercebc
          0
          2
          164

        • Local Google vs. default Google search
          MiriamEllis
          MiriamEllis
          0
          7
          230

        • Google Sitemap - How Long Does it Take Google To Index?
          Chris.Menke
          Chris.Menke
          0
          3
          2.4k

        • When do you use 'Fetch as a Google'' on Google Webmaster?
          MagicDude4Eva
          MagicDude4Eva
          1
          13
          7.5k

        • How to optimize for different google seach center (google.de, google.ch) ?
          Aleyda
          Aleyda
          0
          4
          270

        • I was googling the word "best web hosting" and i notice the 1st and 3rd result were results with google plus. Does Google plus now play a role in improving ranking for the website?
          CMC-SD
          CMC-SD
          0
          4
          318

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy