The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Site Crawl 1-page 301 status error but httpstatus.io says its 403

    Site Crawl 1-page 301 status error but httpstatus.io says its 403

    Other Research Tools
    3 2 38
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • JohnConover
      JohnConover last edited by

      I am trying to run a site crawl for my website and MOZ is only resulting in 1 page crawled with the home page URL Status Code of 301.

      However when I run it in httpstatus.io it is giving me a 403 status error.

      Im curious as to why MOZ is saying its a 301 and httpstatus.io is saying 403.    Is there anything I can do in MOZ first to get the site crawled before asking my developers to look into the 403 error?

      1 Reply Last reply Reply Quote 0
      • dave.kudera
        dave.kudera last edited by

        Hi John - Thanks for posting

        Moz is starting at HTTP, so if you check httpstatus.io from HTTP, you will see a 301 to a 403 response. You would want to have your developer check to see if they are blocking our user-agent "rogerbot" or any AWS IP's because it doesn't look like we can crawl past the root domain.

        If you need further assistance, feel free to reach out to help@moz.com.

        JohnConover 1 Reply Last reply Reply Quote 1
        • JohnConover
          JohnConover @dave.kudera last edited by

          Would this also block the Googlebot?

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Moz Crawl only crawling the top level page (1 page)
            tawnycase
            tawnycase
            0
            2
            198

          • Crawl report shows that it gets 4xx errors for pages that work fine. Why?
            WebElaine
            WebElaine
            0
            4
            209

          • Why do I have so many site crawl issues with my site?
            ThridHour
            ThridHour
            0
            3
            64

          • Crawl Test : Error attempting to request HTTPS page
            MattRoney
            MattRoney
            0
            4
            645

          • I'm getting a Crawl error 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag
            DavidLee
            DavidLee
            1
            13
            939

          • Moz Crawl Test says pages have no internal links
            ChiarynMiranda
            ChiarynMiranda
            0
            4
            331

          • Site crawl errors - download list of all urls
            David-Kley
            David-Kley
            0
            4
            297

          • When attempting to crawl my site, I'm getting the error: Oops! That URL doesn’t resolve, which means your report will be blank. Please fix the issue or change the URL. What's going on here?
            KeriMorgret
            KeriMorgret
            0
            4
            305

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy