The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Other Research Tools
    4. Need to solve "Oops our crawlers were unable to access" url for new campaign

    Need to solve "Oops our crawlers were unable to access" url for new campaign

    Other Research Tools
    2 2 66
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • alisacromer
      alisacromer last edited by

      I'm putting the url designfirstkitchenandbath.com and getting the "oops! our crawlers were unable to access the site. Since this site is a potential client, which shows up online, I can't get access to fix the code, plus while I can write a little html I don't feel comfortable working with hard, live code on someonelse's site. Anyone have a simple solution?

      1 Reply Last reply Reply Quote 0
      • samantha.chapman
        samantha.chapman last edited by

        Hey there!

        Sam from Moz's Help Team here!

        I've taken a look at that URL, and from what I can see it looks like we're running into a 403 error which means that ultimately, access to that URL is forbidden:

        http://www.screencast.com/t/UbMwIrjuQFG

        This 403 error is coming directly from your server, so at this point the best thing to do will be to send this information to your client/their web dev. They'll need to make sure our crawler (rogerbot) is whitelisted, so our tools can start working hard for you, and that you aren't blocking AWS (Amazon Web Services) on the server level.

        I hope this helps - if you have any other questions, feel free to pop a message over to help@moz.com🙂

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • "New" issues not previously found being shown?
          shahryar89
          shahryar89
          0
          5
          47

        • How do can the crawler not access my robots.txt file but have 0 crawler issues?
          tawnycase
          tawnycase
          0
          4
          152

        • "Keywords Showing" total doesn't match "Tracked Keywords" total
          samantha.chapman
          samantha.chapman
          0
          6
          69

        • Need a link rel="canonical"??
          Attain-Design
          Attain-Design
          0
          5
          279

        • Rogerbot will not crawl my site! Site URL is https but keep getting and error that homepage (http) can not be accessed. I set up a second campaign to alter the target url to the newer https version but still getting the same error! What can I do?
          DirkC
          DirkC
          0
          3
          200

        • On-Page Grader "Sorry, but that URL is inaccessible."
          DmitriiK
          DmitriiK
          1
          7
          408

        • I'm getting, "you're not using the rel="canonical" META attribute" in my crawl diagnotic
          webtheoria.com
          webtheoria.com
          0
          4
          141

        • Moz just did my weekly "crawl" and claims my meta titles and descriptions are "missing," but they aren't. What's up with this?
          LifeisRosie
          LifeisRosie
          0
          3
          132

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy