The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Google having trouble accessing my site

    Google having trouble accessing my site

    Technical SEO Issues
    2 2 1.1k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ClaireH-184886
      ClaireH-184886 last edited by

      Hi google is having problem accessing my site. each day it is bringing up access denied errors and when i have checked what this means i have the following

      Access denied errors

      In general, Google discovers content by following links from one page to another. To crawl a page, Googlebot must be able to access it. If you’re seeing unexpected Access Denied errors, it may be for the following reasons:

      • Googlebot couldn’t access a URL on your site because your site requires users to log in to view all or some of your content. (Tip: You can get around this by removing this requirement for user-agent Googlebot.)
      • Your robots.txt file is blocking Google from accessing your whole site or individual URLs or directories.
        • Test that your robots.txt is working as expected. The Test robots.txt tool lets you see exactly how Googlebot will interpret the contents of your robots.txt file. The Google user-agent is Googlebot. (How to verify that a user-agent really is Googlebot.)
        • The Fetch as Google tool helps you understand exactly how your site appears to Googlebot. This can be very useful when troubleshooting problems with your site's content or discoverability in search results.
      • Your server requires users to authenticate using a proxy, or your hosting provider may be blocking Google from accessing your site.

      Now i have contacted my hosting company who said there is not a problem but said to read the following page http://www.tmdhosting.com/kb/technical-questions/other/robots-txt-file-to-improve-the-way-search-bots-crawl/

      i have read it and as far as i can see i have my file set up right which is listed below. they said if i still have problems then i need to contact google. can anyone please give me advice on what to do. the errors are responce code 403

      User-agent: *
      Disallow: /administrator/
      Disallow: /cache/
      Disallow: /components/
      Disallow: /includes/
      Disallow: /installation/
      Disallow: /language/
      Disallow: /libraries/
      Disallow: /media/
      Disallow: /modules/
      Disallow: /plugins/
      Disallow: /templates/
      Disallow: /tmp/
      Disallow: /xmlrpc/

      1 Reply Last reply Reply Quote 0
      • Guest
        Guest last edited by

        This post is deleted!
        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Site address change: new site isn't showing up in Google, old site is gone.
          GlobeRunner
          GlobeRunner
          0
          5
          107

        • 301'd site, but new site is not getting picked up in google.
          evolvingSEO
          evolvingSEO
          1
          28
          406

        • Staging site and "live" site have both been indexed by Google
          jesse-landry
          jesse-landry
          0
          6
          1.3k

        • Google couldn't access your site because of a DNS error
          vayumedia-224580
          vayumedia-224580
          0
          8
          3.9k

        • Mobile site rank on Google S.E. instead of desktop site.
          Webmaster_SEO
          Webmaster_SEO
          0
          3
          1.1k

        • Is it a good idea to make 301 from a site which you know google has banned certain keywords for to a new site with similar content
          SimonCullum
          SimonCullum
          0
          3
          435

        • How much of an issue is it if a site is somehow connected to a site that was penalized by Google?
          DanHill
          DanHill
          0
          3
          617

        • Google.ca is showing our US site instead of our Canada Site
          travelocitysearch
          travelocitysearch
          0
          3
          2.6k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy