The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Can you confirm legitimate Google Bot traffic?

    Can you confirm legitimate Google Bot traffic?

    Technical SEO Issues
    6 3 112
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • akin67
      akin67 last edited by

      We use Cloudflare as a firewall. I noticed a significant number of blocks of bot traffic. One of the things they do is try to block bad bot traffic. But it seems they are mistakenly blocking Google Bot traffic. If you use Cloudflare, you may want to look into this as well. Also, can you confirm if the following IPs are for legitimate Google Bots?

      66.249.79.88
      66.249.79.65
      66.249.79.80

      66.249.79.76

      Thanks,

      1 Reply Last reply Reply Quote 1
      • Xiano
        Xiano last edited by

        Following the advice here: https://support.google.com/webmasters/answer/80553?hl=en I can confirm that they are indeed Googlebot.

        If you use Fetch as Google in Search Console, are you seeing errors?

        Cloudflare has an article here on the subject:

        https://support.cloudflare.com/hc/en-us/articles/200169806-I-m-getting-Google-Crawler-Errors-What-should-I-do-

        GastonRiera 1 Reply Last reply Reply Quote 1
        • GastonRiera
          GastonRiera @Xiano last edited by

          What Alex has pointed out is what you're needing.

          Also, I'd like to remember you that Googlebot crawls from several IP ranges. Not only the 66.xxx.xxx.xx.

          EDIT:
          Alex pointed me out that I've made a mistake. So I've checked my data in server logs.
          In some of the sites I'm working, most of the traffic comes from the range: [66.249.6x.xxx-66.249.7x.xxx]

          Always, when in doubt, with a reverse DNSlookup you'll find out whether it's an official GoogleBot or not.

          Hope it helps.
          Best luck.
          Gaston

          Xiano 1 Reply Last reply Reply Quote 1
          • Xiano
            Xiano @GastonRiera last edited by

            10.0.0.0/8 is a private subnet and therefore unroutable, so I don't think you would have seen traffic from that subnet from Googlebot!

            GastonRiera 1 Reply Last reply Reply Quote 0
            • GastonRiera
              GastonRiera @Xiano last edited by

              Dammit, my mistake. 
              Was proabaly still asleep. I've checked with my log files and updated it 🙂

              Thanks Alex!

              1 Reply Last reply Reply Quote 1
              • akin67
                akin67 last edited by

                Thank you very much for all of your feedback folks. I really appreciate it. Cloudflare has acknowledged that they are aware of the issue and working to correct it. It also affected Bing Bots. I ended up white listing the IP ranges, and our Google crawl has increased as a result.

                1 Reply Last reply Reply Quote 2
                • 1 / 1
                • First post
                  Last post
                • How to track my actual traffic source using Google Analytics which are now showing as referral traffic?
                  TrentonGreener
                  TrentonGreener
                  0
                  8
                  773

                • Google Bot Noindex
                  Andy.Drinkwater
                  Andy.Drinkwater
                  0
                  4
                  72

                • What's going on with google index - javascript and google bot
                  Everett
                  Everett
                  0
                  4
                  475

                • How can i remove and image from google?
                  GPainter
                  GPainter
                  0
                  6
                  109

                • No google traffic for this site? Help?
                  dashesndots
                  dashesndots
                  0
                  3
                  76

                • How can I stop google indexing an image
                  mark_baird
                  mark_baird
                  0
                  5
                  128

                • Does Google Bot accept Cookies
                  jeffreytrull1
                  jeffreytrull1
                  0
                  2
                  2.7k

                • Tracking twitter traffic in Google Analytics
                  ReneReinholdt
                  ReneReinholdt
                  0
                  14
                  2.3k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy