The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Getting Recrawled by Google

    Getting Recrawled by Google

    Technical SEO Issues
    5 3 264
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ShootTokyo
      ShootTokyo last edited by

      I have been updating my site a lot and some of the updates are showing up in Google and some are not.  Is there a best practice in getting your site fully recrawled by Google?

      1 Reply Last reply Reply Quote 0
      • BlueprintMarketing
        BlueprintMarketing last edited by

        Hi,

        Yes here is a link to some good info & tips

        http://www.distilled.net/blog/seo/advanced-seo-troubleshooting-why-isnt-this-page-indexed/

        Absolutely. Make sure you have a fast hosting company hosting your website.

        Make sure there's no flash, Ajax, or JavaScript obscuring your site from Google bot

        Make sure your robots.txt file is not no following or no indexing any thing that you want to be found by Google

        Same goes for your tags

        1. noindex X-Robots-Tag in HTTP header (X-Robots-Tag: noindex)
        2. Incorrect mime type declared in HTTP header. For example, for an HTML document, if it was declared as Content-Type: text/javascript

        You can use Google Webmaster tools and the selection fetches Google bot and submit all URLs to index if you want to make sure it is being indexed in Google knows that you want the site  indexed.

        I hope I've been out sincerely,

        Thomas

        1 Reply Last reply Reply Quote 1
        • BlueprintMarketing
          BlueprintMarketing last edited by

          Heres more

          Kristina Kledzik from distilled wrights about this a lot

          http://www.distilled.net/about/people/kristina-kledzik/

          http://www.zemanta.com/blog/technical-seo-audit-for-publishers/

          http://www.distilled.net/blog/seo/site-navigation-for-seo/

          http://yoast.com/how-to-get-google-to-crawl-your-site-faster/

          http://www.stateofsearch.com/a-guide-to-crawling-indexing-and-ranking-your-websit/

          http://www.distilled.net/blog/seo/how-to-do-a-5-step-site-audit/

          http://www.seerinteractive.com/blog/easy-ways-seo-can-kill-your-site

          Use Screaming Frog SEO Spider Use this with http://www.seerinteractive.com/blog/screaming-frog-guide

          http://www.portent.com/blog/seo/three-seo-deal-killers.htm

          Other good to know

          http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/

          http://www.portent.com/blog/seo/5-seo-strategies-we-swear-arent-going-anywhere.htm

          http://www.mnsearch.org/john-doherty-from-distilled-teaches-mnsearch-about-technical-seo/

          Hope this help's,

          Thomas

          1 Reply Last reply Reply Quote 1
          • BlueprintMarketing
            BlueprintMarketing last edited by

            PS

            #1

            http://www.distilled.net/blog/seo/beginners-guide-doing-a-site-audit-using-google-webmaster-tools/

            http://www.google.com/submityourcontent/

            https://support.google.com/webmasters/answer/1352276?hl=en

            Same rules for Google https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages

            1 Reply Last reply Reply Quote 1
            • Modi
              Modi last edited by

              If your site does not get crawl completely, i will recommend

              a) To create a site-map, so that search engines can understand the site hierarchy and can deep crawl the site

              b) Look at your site structure, Make your site more organized so as to have better crawl. It should not happen that a user needs to visit - home page > category page > sub category page > article or below to read the article. At best, article snippet should come on home page for a day. If not, should be accessible from home page > category page > article

              c) Submit the article posted to Social Media - Reddit, Pinterest, Twitter etc. It will help search engines discover your link faster

              By sure - will improve the crawl mechanism to your site

              1 Reply Last reply Reply Quote 1
              • 1 / 1
              • First post
                Last post
              • How can I get a photo album indexed by Google?
                GastonRiera
                GastonRiera
                0
                4
                413

              • How preproduction website is getting indexed in Google.
                Chris_Hickman
                Chris_Hickman
                0
                7
                460

              • Get List Of All Indexed Google Pages
                UmarKhan
                UmarKhan
                0
                2
                194

              • How to get found on local google search?
                MiriamEllis
                MiriamEllis
                0
                8
                185

              • How do you get a Google+ pic in your SERP snippet
                Nightwing
                Nightwing
                0
                4
                531

              • Why Can't I Get on Google?
                Matt-Williamson
                Matt-Williamson
                0
                2
                351

              • How can I get unimportant pages out of Google?
                KeriMorgret
                KeriMorgret
                0
                11
                1.2k

              • Getting Google to index new pages
                scanlin
                scanlin
                0
                5
                886

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy