The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Page not Accesible for crawler in on-page report

    Page not Accesible for crawler in on-page report

    Technical SEO Issues
    6 2 484
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • TiasNimbas
      TiasNimbas last edited by

      Hi All,

      We started using SEOMoz this week and ran into an issue regarding the crawler access in the on-page report module. The attached screen shot shows that the HTTP status is 200 but SEOMoz still says that the page is not accessible for crawlers. What could this be?

      Page in question
      http://www.tiasnimbas.edu/Executive_MBA/pgeId=307

      Regards,

      Coen

      SEOMoz.png

      1 Reply Last reply Reply Quote 0
      • smokin_ace
        smokin_ace last edited by

        Hi have you tried to check if this page accessible for Google robots in Webmaster Panel. Because sometimes there are some sort of software which are blocking SEOmoz robot.

        Also check your robots.txt file if there are no any restrictions. For ex. it might be setup to accept only Google robot but not others.

        TiasNimbas 1 Reply Last reply Reply Quote 1
        • TiasNimbas
          TiasNimbas @smokin_ace last edited by

          Hi, Yes i have check it through the webmaster tools :

          `Result:
          HTTP/1.1 200 OK
          Cache-Control: public, max-age=1
          Content-Type: text/html; charset=utf-8
          Content-Encoding: gzip
          Expires: Tue, 06 Dec 2011 14:27:57 GMT
          Last-Modified: Tue, 06 Dec 2011 14:27:56 GMT
          Vary: Accept-Encoding
          Server: Microsoft-IIS/7.5
          City: /Executive_MBA/pgeId=307
          Set-Cookie: ASP.NET_SessionId=wb3k3i45cxmag3mh31swghbz;
           domain=.tiasnimbas.edu; path=/; HttpOnly
          X-AspNet-Version: 2.0.50727
          X-Powered-By: ASP.NET
          Date: Tue, 06 Dec 2011 14:27:56 GMT
          Content-Length: 12991
          
          The robot.txt allows all crawlers:`
          User-agent: *
          Sitemap: http://www.tiasnimbas.edu/sitemap.xml
          
          
          smokin_ace TiasNimbas 3 Replies Last reply Reply Quote 0
          • smokin_ace
            smokin_ace @TiasNimbas last edited by

            I've just checked your Google Cache for this page and it seems to be fine. I advise you don't worry that much about SEOmoz robot.

            1 Reply Last reply Reply Quote 1
            • TiasNimbas
              TiasNimbas @TiasNimbas last edited by

              Ok super thank you

              1 Reply Last reply Reply Quote 0
              • smokin_ace
                smokin_ace @TiasNimbas last edited by

                Most welcome 😉

                You can install Mozbar if you are using FF or Chrome, it has a lot of useful features.

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Why are crawlers not picking up these pages?
                  LynnPatchett
                  LynnPatchett
                  0
                  2
                  147

                • Blog Page Titles - Page 1, Page 2 etc.
                  Paul-Gross
                  Paul-Gross
                  0
                  8
                  549

                • Should I use Event Schema for a page that reports on an event?
                  Martijn_Scheijbeler
                  Martijn_Scheijbeler
                  0
                  2
                  125

                • New Page Showing Up On My Reports w/o Page Title, Words, etc - However, I didn't create it
                  webbmason
                  webbmason
                  0
                  5
                  71

                • I am trying to correct error report of duplicate page content. However I am unable to find in over 100 blogs the page which contains similar content to the page SEOmoz reported as having similar content is my only option to just dlete the blog page?
                  evolvingSEO
                  evolvingSEO
                  0
                  4
                  344

                • On page report Confusing Whats wrong?
                  jeffreytrull1
                  jeffreytrull1
                  0
                  3
                  291

                • Crawl report showing only 1 crawled page
                  Mikpam
                  Mikpam
                  0
                  4
                  913

                • On-Page Report Card, rel canonical
                  Breakout
                  Breakout
                  0
                  8
                  1.1k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy