The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Questions
    4. Switched to Https and now MOZ crawl fails

    Switched to Https and now MOZ crawl fails

    Other Questions
    2 2 79
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DougDeVore
      DougDeVore last edited by

      Hey all-

      I have posted this previously, but this has never been resolved.  I was instructed to "check the logs", but I am on a shared host and don't have access to them.

      I finally got around to sending a note to flywheel a note about this problem and they came back that everything is fine.  I am not sure what to do here?  As I said its on a shared host, so I don't have console\audit log access, however Flywheel is one of the best wordpress hosting companies out there (only thing they do).

      As far as accessing the robots.txt file, I can go directly to it without any problems?  You can also hit the website without any problems either?

      https://southernil.com/robots.txt

      1 Reply Last reply Reply Quote 0
      • moz_support
        moz_support last edited by

        Hi there,

        Sorry for the trouble! We attempted to access that robots.txt page and it does look like we were hitting a "too many redirects" error. You will also want to make sure you are not blocking AWS, as that would stop us entirely. Checking the logs is really one of the best ways to determine how exactly your site is responding to our crawler, and if there's any way at all to get those that would be ideal for troubleshooting. Without logs, there isn't a ton we can definitively investigate. 😞

        If you have questions or logs you would like to send over, we'd recommend reaching out to us at help@moz.com so that we can check out the campaign as well. Sorry we can't be more help here!

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Can I limit Moz crawl to site map?
          bradsimonis
          bradsimonis
          0
          7
          43

        • Moz crawl crashing my site?
          AndyMozster
          AndyMozster
          0
          3
          199

        • How do I disallow MOZ from crawling URL's with parameters?
          Dezzign
          Dezzign
          0
          3
          340

        • When migrating to https do you need change anything in Moz campaign settings ?
          CelestialChook
          CelestialChook
          0
          4
          172

        • When does SEO.Moz run its crawl?
          stevefidelity
          stevefidelity
          0
          8
          1.2k

        • Moz Analytics now has Monthly reporting
          S2RSolutions
          S2RSolutions
          0
          5
          138

        • Moz Hasn't Crawled my Sites In Two Weeks
          AaronWheeler
          AaronWheeler
          0
          3
          157

        • Is there a way to change crawling time for moz and to do it in a less demanding hour of the day?
          ChiarynMiranda
          ChiarynMiranda
          0
          3
          410

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy