The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Feature Requests
    4. Does Rogerbot support SNI? - And if not All sites behind Cloudflare are probably uncrawlable.

    Does Rogerbot support SNI? - And if not All sites behind Cloudflare are probably uncrawlable.

    Feature Requests
    33 19 1.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Virtualsolutions
      Virtualsolutions last edited by

      Is there an update or ETA for this fix? I have a client hosted on GoDaddy and cannot crawl the site due to CF

      MaxxDesign 1 Reply Last reply Reply Quote 0
      • MaxxDesign
        MaxxDesign @Virtualsolutions last edited by

        Hi, OP here (on a different Work account!)

        If they upgrade to the pro level, CF SSL certs should now auto fallback for non SNI requests.

        Not ideal, and Moz still need to fix the underlaying issue with the out of date version of Python that Rogerbot is written in... but it should provide a fix.

        1 Reply Last reply Reply Quote 0
        • Senson
          Senson last edited by

          Just want to point out that all modern browsers support SNI and more and more sites will be using it as Google and Mozilla start to make their browsers warn users of unencrypted sites.

          That this issue hasn't been fixed since it was brought to Moz.com's attention is disappointing.

          1 Reply Last reply Reply Quote 0
          • a_w00kie
            a_w00kie last edited by

            Is there an alternative to Moz that supports SNI ? not being able to crawl SNI enabled websites is a major problem.

            1 Reply Last reply Reply Quote 0
            • orlando-rehash
              orlando-rehash last edited by

              Any updates to this? I just started the Moz 30-day trial, and if this isn't available (I'm not going to pay for Cloudflare pro), I'm going to cancel Moz when my free 30 days are up.

              1 Reply Last reply Reply Quote 0
              • Pentangle
                Pentangle last edited by

                Raised in "Jun 03, 2015" and still it doesn't work?

                Seriously need sorting or we'll be off to a competitor.

                1 Reply Last reply Reply Quote 1
                • kent.dagnall
                  kent.dagnall last edited by

                  +1 We must also use another service if Moz cannot fix their crawler issues. Roger should be one of the best bots out there for what Moz charges. Come to find out it's built on an ancient Python version and needs to be completely rewritten.

                  jameskais 1 Reply Last reply Reply Quote 0
                  • Rachelle_Henderson
                    Rachelle_Henderson last edited by

                    Hi! Has this been taken care of yet? It's February 2017 and we also use cloudflare, and right now I can't pull any rankings since Moz can't crawl our sites. We love Moz and do not want to cancel the service, but this is ridiculous.

                    jameskais 1 Reply Last reply Reply Quote 1
                    • jameskais
                      jameskais @Rachelle_Henderson last edited by

                      Hi Rachelle, I've added your name to our beta crawl list and hopefully we can get you added shortly. As a note SNI does not impact ranking collections but only site crawls. Please let help@moz.com know if you are seeing issues with rankings collections.

                      Rachelle_Henderson acreedon 2 Replies Last reply Reply Quote 0
                      • jameskais
                        jameskais @kent.dagnall last edited by

                        Hi Kent, I've added your name to our beta crawl list and hopefully we can get you added shortly. We are well underway with that re-write and will get you on a crawl that works for you shortly!

                        1 Reply Last reply Reply Quote 0
                        • Rachelle_Henderson
                          Rachelle_Henderson @jameskais last edited by

                          Hi James, thank you so much! We are seeing issues with rankings for our 2 accounts using Cloudflare. I gave myself a heart attack thinking that the client's site tanked and then dug around to find the issue in the forums. It may be worth it to create a blog to let the public know what's going on so other webmasters don't freak out too since it seems a lot of us are running into this error.

                          1 Reply Last reply Reply Quote 0
                          • acreedon
                            acreedon @jameskais last edited by

                            Hi James, this is also a big problem for us. Can you add me to the beta group - aine@npqmag.org? Otherwise we may have to go elsewhere for our SEO tools.

                            1 Reply Last reply Reply Quote 0
                            • JaredBroussard
                              JaredBroussard @SYG last edited by

                              We are having issues with crawls for all HubSpot hosted sites as well. We love Moz so we are hoping there is a workaround for the issue. If anyone has an update on this topic, I am all ears. Thank you.

                              1 Reply Last reply Reply Quote 0
                              • 1
                              • 2
                              • 2 / 2
                              • First post
                                Last post
                              • How i can increase my site Moz DA and keyword difficulty difficulty?
                                4helal
                                4helal
                                0
                                5
                                58

                              • Why my site not crawl?
                                dave.kudera
                                dave.kudera
                                0
                                7
                                75

                              • How Often Does Moz Crawl a Site for DA
                                eli.myers
                                eli.myers
                                1
                                14
                                819

                              • In Moz's Keyword Explorer/Explore By Site, Can I Exclude a Keyword From the Results?
                                MrWhippy
                                MrWhippy
                                0
                                2
                                58

                              • Can Moz add an alert to email us when a competitor's site gets a new backlink?
                                martinxm
                                martinxm
                                0
                                3
                                74

                              • MOZ Site Crawl - Ignore functionality Request
                                jocameron
                                jocameron
                                0
                                4
                                107

                              • Crawl test limitaton - ways to take advantage of large sites?
                                KristinaKeyser
                                KristinaKeyser
                                0
                                2
                                58

                              • Does Moz Pro provide a back link suggestion area for a particular site?
                                DenisZilberberg
                                DenisZilberberg
                                0
                                3
                                291

                              Get started with Moz Pro!

                              Unlock the power of advanced SEO tools and data-driven insights.

                              Start my free trial
                              Products
                              • Moz Pro
                              • Moz Local
                              • Moz API
                              • Moz Data
                              • STAT
                              • Product Updates
                              Moz Solutions
                              • SMB Solutions
                              • Agency Solutions
                              • Enterprise Solutions
                              • Digital Marketers
                              Free SEO Tools
                              • Domain Authority Checker
                              • Link Explorer
                              • Keyword Explorer
                              • Competitive Research
                              • Brand Authority Checker
                              • Local Citation Checker
                              • MozBar Extension
                              • MozCast
                              Resources
                              • Blog
                              • SEO Learning Center
                              • Help Hub
                              • Beginner's Guide to SEO
                              • How-to Guides
                              • Moz Academy
                              • API Docs
                              About Moz
                              • About
                              • Team
                              • Careers
                              • Contact
                              Why Moz
                              • Case Studies
                              • Testimonials
                              Get Involved
                              • Become an Affiliate
                              • MozCon
                              • Webinars
                              • Practical Marketer Series
                              • MozPod
                              Connect with us

                              Contact the Help team

                              Join our newsletter
                              Moz logo
                              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                              • Accessibility
                              • Terms of Use
                              • Privacy