The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Can you confirm legitimate Google Bot traffic?

    Can you confirm legitimate Google Bot traffic?

    Technical SEO Issues
    6 3 112
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • akin67
      akin67 last edited by

      We use Cloudflare as a firewall. I noticed a significant number of blocks of bot traffic. One of the things they do is try to block bad bot traffic. But it seems they are mistakenly blocking Google Bot traffic. If you use Cloudflare, you may want to look into this as well. Also, can you confirm if the following IPs are for legitimate Google Bots?

      66.249.79.88
      66.249.79.65
      66.249.79.80

      66.249.79.76

      Thanks,

      1 Reply Last reply Reply Quote 1
      • Xiano
        Xiano last edited by

        Following the advice here: https://support.google.com/webmasters/answer/80553?hl=en I can confirm that they are indeed Googlebot.

        If you use Fetch as Google in Search Console, are you seeing errors?

        Cloudflare has an article here on the subject:

        https://support.cloudflare.com/hc/en-us/articles/200169806-I-m-getting-Google-Crawler-Errors-What-should-I-do-

        GastonRiera 1 Reply Last reply Reply Quote 1
        • GastonRiera
          GastonRiera @Xiano last edited by

          What Alex has pointed out is what you're needing.

          Also, I'd like to remember you that Googlebot crawls from several IP ranges. Not only the 66.xxx.xxx.xx.

          EDIT:
          Alex pointed me out that I've made a mistake. So I've checked my data in server logs.
          In some of the sites I'm working, most of the traffic comes from the range: [66.249.6x.xxx-66.249.7x.xxx]

          Always, when in doubt, with a reverse DNSlookup you'll find out whether it's an official GoogleBot or not.

          Hope it helps.
          Best luck.
          Gaston

          Xiano 1 Reply Last reply Reply Quote 1
          • Xiano
            Xiano @GastonRiera last edited by

            10.0.0.0/8 is a private subnet and therefore unroutable, so I don't think you would have seen traffic from that subnet from Googlebot!

            GastonRiera 1 Reply Last reply Reply Quote 0
            • GastonRiera
              GastonRiera @Xiano last edited by

              Dammit, my mistake. 
              Was proabaly still asleep. I've checked with my log files and updated it 🙂

              Thanks Alex!

              1 Reply Last reply Reply Quote 1
              • akin67
                akin67 last edited by

                Thank you very much for all of your feedback folks. I really appreciate it. Cloudflare has acknowledged that they are aware of the issue and working to correct it. It also affected Bing Bots. I ended up white listing the IP ranges, and our Google crawl has increased as a result.

                1 Reply Last reply Reply Quote 2
                • 1 / 1
                • First post
                  Last post
                • Google Crawling Issues! How Can I Get Google to Crawl My Website Regularly?
                  libero_net
                  libero_net
                  1
                  8
                  142

                • What's going on with google index - javascript and google bot
                  Everett
                  Everett
                  0
                  4
                  475

                • How can i remove and image from google?
                  GPainter
                  GPainter
                  0
                  6
                  109

                • Google webmaster showing 0 indexed, yet I can see them all them Google search?
                  Martijn_Scheijbeler
                  Martijn_Scheijbeler
                  0
                  4
                  102

                • Google bot notification
                  juanmiguelcr
                  juanmiguelcr
                  0
                  3
                  97

                • Google bot index
                  Dr-Pete
                  Dr-Pete
                  0
                  6
                  274

                • How a google bot sees your site
                  SearchDexSEO
                  SearchDexSEO
                  0
                  7
                  4.4k

                • How can i increase my website traffic
                  KeriMorgret
                  KeriMorgret
                  0
                  4
                  661

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy