The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Crawling issues in google

    Crawling issues in google

    Technical SEO Issues
    4 2 258
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CMTM
      CMTM last edited by

      Hi everyone,

      I think i have crawling issues with one of my sites.

      It has vanished form Google rankings it used to rank for all services i offered now it doesn't anymore ever since September 29th.

      I have resubmitted to Google 2 times and they came back with the same answer:

      "

      We reviewed your site and found no manual actions by the web spam team that might affect your site's ranking in Google. There's no need to file a reconsideration request for your site, because any ranking issues you may be experiencing are not related to a manual action taken by the webspam team.

      Of course, there may be other issues with your site that affect your site's ranking. Google's computers determine the order of our search results using a series of formulas known as algorithms. We make hundreds of changes to our search algorithms each year, and we employ more than 200 different signals when ranking pages. As our algorithms change and as the web (including your site) changes, some fluctuation in ranking can happen as we make updates to present the best results to our users.

      If you've experienced a change in ranking which you suspect may be more than a simple algorithm change, there are other things you may want to investigate as possible causes, such as a major change to your site's content, content management system, or server architecture. For example, a site may not rank well if your server stops serving pages to Googlebot, or if you've changed the URLs for a large portion of your site's pages. This article has a list of other potential reasons your site may not be doing well in search.

      "

      How i detected that it may be a crawling issue is that 2 weeks ago i changed metas - metas are very slow in getting updated and for some of my pages never did update

      Do you know any good tools to check for bad code that could slow down the crawling. I really don't know where to look other than issues for crawling. I validated the website with w3c validator and ran xenu and cleaned these up but my website is still down.

      Any ideas are appreciated.

      1 Reply Last reply Reply Quote 0
      • Keszi
        Keszi last edited by

        Hey Cary,

        The first thing I would do is to go into Google Webmaster tools -> Health -> Fetch as Googlebot.

        Now under Fetch status you should have "Success" if Google managed to fetch the information. Click on it, and check the first few rows, you should see something like:

        <code>HTTP/1.1 200 OK
        Date: Fri, 10 Nov 2012 00:26:17 GMT</code>
        

        If you do see an other response then leave it as a response to this question so we can have investigate further with you.

        Gr.,

        Istvan

        CMTM 2 Replies Last reply Reply Quote 0
        • CMTM
          CMTM @Keszi last edited by

          Hi,

          I already did do that a while ago...i still think i have a javascript issue.

          I  already did do the GWMT, w3c validation - but none of that helped

          Date: Monday, October 22, 2012 5:00:59 PM PDT

          Googlebot Type: Web

          Download Time (in milliseconds): 115

          <code>HTTP/1.1 200 OK
          Date: Tue, 23 Oct 2012 00:00:59 GMT</code>
          
          1 Reply Last reply Reply Quote 0
          • CMTM
            CMTM @Keszi last edited by

            i ran another one

            Date: Saturday, November 10, 2012 4:52:04 PM PST

            Googlebot Type: Web

            Download Time (in milliseconds): 94

            <code>HTTP/1.1 200 OK
            Date: Sun, 11 Nov 2012 00:52:04 GMT</code>
            
            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Google Cache issue
              willcritchlow
              willcritchlow
              0
              4
              461

            • Crawl Issues / Partial Fetch Via Google
              vikasnwu
              vikasnwu
              0
              5
              574

            • Google Crawling Issues! How Can I Get Google to Crawl My Website Regularly?
              libero_net
              libero_net
              1
              8
              142

            • Crawl issues
              Christy-Correll
              Christy-Correll
              0
              3
              105

            • I have 3500 pages crawled by Google, - why is SEOMOZ only able to crawl 400 of these ?
              Abe_Schmidt
              Abe_Schmidt
              0
              2
              95

            • Odd Google Indexing Issue
              Mcarle
              Mcarle
              0
              2
              539

            • Google crawl index issue with our website...
              ILM_Marketing
              ILM_Marketing
              0
              10
              1.1k

            • Crawl issues/ .htacess issues
              StalkerB
              StalkerB
              0
              6
              1.1k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy