The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Feature Requests
    4. Does Rogerbot support SNI? - And if not All sites behind Cloudflare are probably uncrawlable.

    Does Rogerbot support SNI? - And if not All sites behind Cloudflare are probably uncrawlable.

    Feature Requests
    33 19 1.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SYG
      SYG last edited by

      Been a long time MOZ user and just found out this was an issue after implementing SSL on Hubspot.com

      They are hosting our site and offered a no cost option to activate SSL, which I did, and now MOZ cannot crawl any longer.

      Now anyone who is hosting their site at Hubspot and activates SSL will not be able to use Moz to crawl their site

      Can't believe this is not being fixed asap by MOZ

      JaredBroussard 1 Reply Last reply Reply Quote 2
      • Virtualsolutions
        Virtualsolutions last edited by

        Is there an update or ETA for this fix? I have a client hosted on GoDaddy and cannot crawl the site due to CF

        MaxxDesign 1 Reply Last reply Reply Quote 0
        • MaxxDesign
          MaxxDesign @Virtualsolutions last edited by

          Hi, OP here (on a different Work account!)

          If they upgrade to the pro level, CF SSL certs should now auto fallback for non SNI requests.

          Not ideal, and Moz still need to fix the underlaying issue with the out of date version of Python that Rogerbot is written in... but it should provide a fix.

          1 Reply Last reply Reply Quote 0
          • Senson
            Senson last edited by

            Just want to point out that all modern browsers support SNI and more and more sites will be using it as Google and Mozilla start to make their browsers warn users of unencrypted sites.

            That this issue hasn't been fixed since it was brought to Moz.com's attention is disappointing.

            1 Reply Last reply Reply Quote 0
            • a_w00kie
              a_w00kie last edited by

              Is there an alternative to Moz that supports SNI ? not being able to crawl SNI enabled websites is a major problem.

              1 Reply Last reply Reply Quote 0
              • orlando-rehash
                orlando-rehash last edited by

                Any updates to this? I just started the Moz 30-day trial, and if this isn't available (I'm not going to pay for Cloudflare pro), I'm going to cancel Moz when my free 30 days are up.

                1 Reply Last reply Reply Quote 0
                • Pentangle
                  Pentangle last edited by

                  Raised in "Jun 03, 2015" and still it doesn't work?

                  Seriously need sorting or we'll be off to a competitor.

                  1 Reply Last reply Reply Quote 1
                  • kent.dagnall
                    kent.dagnall last edited by

                    +1 We must also use another service if Moz cannot fix their crawler issues. Roger should be one of the best bots out there for what Moz charges. Come to find out it's built on an ancient Python version and needs to be completely rewritten.

                    jameskais 1 Reply Last reply Reply Quote 0
                    • Rachelle_Henderson
                      Rachelle_Henderson last edited by

                      Hi! Has this been taken care of yet? It's February 2017 and we also use cloudflare, and right now I can't pull any rankings since Moz can't crawl our sites. We love Moz and do not want to cancel the service, but this is ridiculous.

                      jameskais 1 Reply Last reply Reply Quote 1
                      • jameskais
                        jameskais @Rachelle_Henderson last edited by

                        Hi Rachelle, I've added your name to our beta crawl list and hopefully we can get you added shortly. As a note SNI does not impact ranking collections but only site crawls. Please let help@moz.com know if you are seeing issues with rankings collections.

                        Rachelle_Henderson acreedon 2 Replies Last reply Reply Quote 0
                        • jameskais
                          jameskais @kent.dagnall last edited by

                          Hi Kent, I've added your name to our beta crawl list and hopefully we can get you added shortly. We are well underway with that re-write and will get you on a crawl that works for you shortly!

                          1 Reply Last reply Reply Quote 0
                          • Rachelle_Henderson
                            Rachelle_Henderson @jameskais last edited by

                            Hi James, thank you so much! We are seeing issues with rankings for our 2 accounts using Cloudflare. I gave myself a heart attack thinking that the client's site tanked and then dug around to find the issue in the forums. It may be worth it to create a blog to let the public know what's going on so other webmasters don't freak out too since it seems a lot of us are running into this error.

                            1 Reply Last reply Reply Quote 0
                            • acreedon
                              acreedon @jameskais last edited by

                              Hi James, this is also a big problem for us. Can you add me to the beta group - aine@npqmag.org? Otherwise we may have to go elsewhere for our SEO tools.

                              1 Reply Last reply Reply Quote 0
                              • JaredBroussard
                                JaredBroussard @SYG last edited by

                                We are having issues with crawls for all HubSpot hosted sites as well. We love Moz so we are hoping there is a workaround for the issue. If anyone has an update on this topic, I am all ears. Thank you.

                                1 Reply Last reply Reply Quote 0
                                • 1
                                • 2
                                • 2 / 2
                                • First post
                                  Last post
                                • Restrict rogerbot for few days
                                  BartonInteractive
                                  BartonInteractive
                                  0
                                  5
                                  32

                                • Why my site not crawl?
                                  dave.kudera
                                  dave.kudera
                                  0
                                  7
                                  75

                                • On page Grader is not working on specific site
                                  BandungFoto
                                  BandungFoto
                                  0
                                  7
                                  177

                                • MOZ Site Crawl - Ignore functionality question
                                  Prasadgotteti
                                  Prasadgotteti
                                  1
                                  5
                                  169

                                • Migrate campaign from when site changes from http:// to https://
                                  BentoPres
                                  BentoPres
                                  0
                                  4
                                  72

                                • Does the Difficulty score in Keyword Explorer take into account my site's domain authority relative to the competition?
                                  moz_support
                                  moz_support
                                  0
                                  4
                                  129

                                • Crawl test limitaton - ways to take advantage of large sites?
                                  KristinaKeyser
                                  KristinaKeyser
                                  0
                                  2
                                  58

                                • Does Moz Pro provide a back link suggestion area for a particular site?
                                  DenisZilberberg
                                  DenisZilberberg
                                  0
                                  3
                                  291

                                Get started with Moz Pro!

                                Unlock the power of advanced SEO tools and data-driven insights.

                                Start my free trial
                                Products
                                • Moz Pro
                                • Moz Local
                                • Moz API
                                • Moz Data
                                • STAT
                                • Product Updates
                                Moz Solutions
                                • SMB Solutions
                                • Agency Solutions
                                • Enterprise Solutions
                                • Digital Marketers
                                Free SEO Tools
                                • Domain Authority Checker
                                • Link Explorer
                                • Keyword Explorer
                                • Competitive Research
                                • Brand Authority Checker
                                • Local Citation Checker
                                • MozBar Extension
                                • MozCast
                                Resources
                                • Blog
                                • SEO Learning Center
                                • Help Hub
                                • Beginner's Guide to SEO
                                • How-to Guides
                                • Moz Academy
                                • API Docs
                                About Moz
                                • About
                                • Team
                                • Careers
                                • Contact
                                Why Moz
                                • Case Studies
                                • Testimonials
                                Get Involved
                                • Become an Affiliate
                                • MozCon
                                • Webinars
                                • Practical Marketer Series
                                • MozPod
                                Connect with us

                                Contact the Help team

                                Join our newsletter
                                Moz logo
                                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                • Accessibility
                                • Terms of Use
                                • Privacy