The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Google webmaster tools says access denied for 77 urls

    Google webmaster tools says access denied for 77 urls

    Technical SEO Issues
    5 2 530
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ClaireH-184886
      ClaireH-184886 last edited by

      Hi i am looking in google webmaster tools and i have seen a major problem which i hope people can help me sort out.

      The problem is, i am being told that 77 urls are being denied access. The message when i look for more information says the below

      Googlebot couldn't crawl your URL because your server either requires login to access the page, or is blocking Googlebot from accessing your site.

      the responce code is 403

      here is a couple of examples

      http://www.in2town.co.uk/Entertainment-Magazine

      http://www.in2town.co.uk/Weight-Loss-Hypnotherapy-helped-woman-lose-3-stone

      i think the problem could be that i have sent them to another url in my httaccess file using the 403 re-direct but why would it bring up that google bot could not crawl them

      any help would be great

      1 Reply Last reply Reply Quote 0
      • eatyourveggies
        eatyourveggies last edited by

        In Webmaster Tools, you can "fetch as google bot" meaning you can enter one of those 77 URLs, and see what the Google "bot" sees when going to that URL.

        You can also use:

        http://www.dnsqueries.com/en/googlebot_simulator.php

        For the URL: http://www.in2town.co.uk/Entertainment-Magazine

        the Google Bot Simulator says:

        HTTP CODE = HTTP/1.1 301 Moved Permanently

        Location = http://www.in2town.co.uk/Showbiz-Gossip

        and for: http://www.in2town.co.uk/Weight-Loss-Hypnotherapy-helped-woman-lose-3-stone

        HTTP CODE = HTTP/1.1 301 Moved Permanently

        Location = http://www.in2town.co.uk/Weight-Loss-Hypnotherapy

        Interestingly, both the NEW URLs work fine although http://www.in2town.co.uk/Weight-Loss-Hypnotherapy doesn't look too good (at least in my web browser) but that's another issue.

        You have a fairly complex .htaccess file (hint: I looked up your OLD .htaccess file - you should delete old htaccess files or something so people can't access them via a web browser), so I'm guessing the problem will be within your .htaccess file.

        If possible, put a plain and simple .htaccess file on, test it with Google Webmaster Tools and see if the error still persists.

        Adam

        ClaireH-184886 1 Reply Last reply Reply Quote 2
        • ClaireH-184886
          ClaireH-184886 @eatyourveggies last edited by

          You have a fairly complex .htaccess file (hint: I looked up your OLD .htaccess file - you should delete old htaccess files or something so people can't access them via a web browser), so I'm guessing the problem will be within your .htaccess file.

          If possible, put a plain and simple .htaccess file on, test it with Google Webmaster Tools and see if the error still persists.

          hi thanks for that. i will delete the old one now

          eatyourveggies 1 Reply Last reply Reply Quote 0
          • ClaireH-184886
            ClaireH-184886 last edited by

            I have now deleted the old version can you check on this and make sure you can no longer see it.

            1 Reply Last reply Reply Quote 0
            • eatyourveggies
              eatyourveggies @ClaireH-184886 last edited by

              Yup, deleted.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Google Webmaster Tools is saying "Sitemap contains urls which are blocked by robots.txt" after Https move...
                vetofunk
                vetofunk
                0
                5
                11.2k

              • Does Google add parameters to the URL parameters in webmaster tools/
                merch_zzounds
                merch_zzounds
                0
                7
                208

              • Weird Cigarette URLs showing up in Google Webmaster Tools
                TheBatesMillStore
                TheBatesMillStore
                0
                10
                623

              • Google webmaster tools says access denied error 403
                ClaireH-184886
                ClaireH-184886
                0
                7
                3.3k

              • Has Google Stopped Listing URLs with Crawl Errors in Webmaster Tools?
                SEOAndy
                SEOAndy
                0
                2
                129

              • Should we block URL param in Webmaster tools after URL migration?
                gmk1567
                gmk1567
                0
                2
                594

              • Does Google pass link juice a page receives if the URL parameter specifies content and has the Crawl setting in Webmaster Tools set to NO?
                Jen_Floyd
                Jen_Floyd
                0
                13
                2.2k

              • Access To Client's Google Webmaster Tools
                94501
                94501
                0
                7
                995

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy