The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. What is the full User Agent of Rogerbot?

    What is the full User Agent of Rogerbot?

    Moz Tools
    3 3 4.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • rightmove
      rightmove last edited by

      What's the exact string that Rogerbot send out as his UserAgent within the HTTP Request? Does it ever differ?

      1 Reply Last reply Reply Quote 0
      • rishil
        rishil last edited by

        Best way to get that info is to hit up Site Support - via http://www.seomoz.org/dp/rogerbot

        1 Reply Last reply Reply Quote 0
        • prima-253509
          prima-253509 last edited by

          I know this is an insanely old question, but as I was looking it up as well and stumbled on this page I thought I would provide some updated info in case anyone else is looking.

          The user agent can't be found on the page that is listed anymore. However it is on https://moz.com/help/guides/moz-procedures/what-is-rogerbot

          Here is how our server reported Rogerbot in its access logs (taken from May 2013). Notice that there is a difference with the crawler-[number]

          rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot, rogerbot-crawler+pr1-crawler-02@seomoz.org
          rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot, rogerbot-crawler+pr1-crawler-16@seomoz.org)

          [updated link added by admin]

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • Which backlinks sites to use for full competitive research
            katobkato
            katobkato
            0
            2
            96

          • Allow only Rogerbot, not googlebot nor undesired access
            MilosMilcom
            MilosMilcom
            0
            4
            989

          • What user agent is used by SEOMOZ crawler?
            Martijn_Scheijbeler
            Martijn_Scheijbeler
            0
            2
            4.3k

          • Data Update for RogerBot
            nicolobottazzi
            nicolobottazzi
            0
            3
            434

          • How do I get our full domain link profile?
            RobertFisher
            RobertFisher
            0
            4
            214

          • Does Rogerbot respect the robots.txt file for wildcards?
            AC_Pro
            AC_Pro
            0
            4
            574

          • Rogerbot not showing in logs
            kenneth_martin
            kenneth_martin
            0
            3
            342

          • How long is a full crawl?
            jgenesto
            jgenesto
            0
            4
            455

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy