The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Search Engine Trends
    4. How long does google takes to crawl a single site ?

    How long does google takes to crawl a single site ?

    Search Engine Trends
    10 4 107
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Sam09schulz
      Sam09schulz last edited by

      lately i have been thinking , when a  crawler visits an already visited site  or indexed site, whats the duration of its scanning?

      1 Reply Last reply Reply Quote 0
      • Joseph-Green-SEO
        Joseph-Green-SEO last edited by

        My Friend, It is different with each website and its different every day.

        You can see it in 2 ways.

        1. By setting up and checking your server logs.

        2. Google is showing you  how many pages they crawled each day and how long it took them  in the Crawl Stats chart in Search Consol (Legacy tools)

        I wish you all the best!

        Joseph Green

        Sam09schulz 1 Reply Last reply Reply Quote 0
        • Vanderlindemedia
          Vanderlindemedia last edited by

          If you update your website 'frequently' the crawler will be more there, if you dont update your website frequently the crawler will slowly back down. Ive had a client's website not updated in perhaps 2 years. We installed a complete new website with new content and it took months for it to be completely re-indexed.

          Sam09schulz 1 Reply Last reply Reply Quote 0
          • Sam09schulz
            Sam09schulz @Vanderlindemedia last edited by

            No you got me wrong my question was when crawler visit the website how much time does it spends there , like one hour two hours

            Vanderlindemedia 1 Reply Last reply Reply Quote 0
            • Sam09schulz
              Sam09schulz @Joseph-Green-SEO last edited by

              No you got me wrong my question was when crawler visit the website how much time does it spends there , like one hour two hours

              1 Reply Last reply Reply Quote 0
              • Vanderlindemedia
                Vanderlindemedia @Sam09schulz last edited by

                It just indexes your pages. That could be done in less then a minute if it wanted. If you have everything structured with for example an up to date sitemap, no 404's or anything then your good to go really. Crawl speed is a factor on how much time it spends on the website. Crawl speed is mandatory when google is requesting alot of pages at the same time that could slow it down, or be triggered by a firewall for having too much connections at the same time.

                Really these things are usually something from the past. If you want a quick index throw in a link on social media for example or get a quality link from some other place that's indexed more often.

                Sam09schulz 1 Reply Last reply Reply Quote 0
                • Sam09schulz
                  Sam09schulz @Vanderlindemedia last edited by

                  and how would i know that there are some sites which are indexed more often. any factors?

                  actually i want my editorial backlinks to get indexed. those links are just not indexed and its been 6 months, ichecked in google search and search console.

                  Vanderlindemedia 1 Reply Last reply Reply Quote 0
                  • olaseo
                    olaseo last edited by

                    I have same issue too. I have built couple of back links and still waiting for the index

                    Vanderlindemedia 1 Reply Last reply Reply Quote 0
                    • Vanderlindemedia
                      Vanderlindemedia @Sam09schulz last edited by

                      Update frequency, i.e how many times your updating, and value of the website for google.  Ive seen my own website being crawled daily at some point.

                      1 Reply Last reply Reply Quote 0
                      • Vanderlindemedia
                        Vanderlindemedia @olaseo last edited by

                        You could do "site:yoururl.com" in google search to see what's indexed in Google.

                        1 Reply Last reply Reply Quote 0
                        • 1 / 1
                        • First post
                          Last post
                        • Google Search Analytics desktop site to losing page position compared to the mobile version of the site
                          merch_zzounds
                          merch_zzounds
                          0
                          3
                          57

                        • How long for google to de-index old pages on my site?
                          rubennunez
                          rubennunez
                          0
                          7
                          8.1k

                        • Do we take a SEO hit for having multiple URLs on an infinite scroll page vs a site with many pages/URLs. If we do take a hit, quantify the hit we would suffer.
                          AlanBleiweiss
                          AlanBleiweiss
                          0
                          3
                          268

                        • How long does google take to re-ranking pages in results?
                          JaneCopland
                          JaneCopland
                          0
                          5
                          837

                        • Google Site Links question
                          trung.ngo
                          trung.ngo
                          0
                          5
                          553

                        • Does anyone know if Google ranks a responsive site, or a specific mobile site higher than each other?
                          irvingw
                          irvingw
                          0
                          4
                          276

                        • Does Google factor in site traffic, time on site, bounce rate, etc into it's ranking algorithm?
                          CPU
                          CPU
                          0
                          5
                          1.4k

                        Get started with Moz Pro!

                        Unlock the power of advanced SEO tools and data-driven insights.

                        Start my free trial
                        Products
                        • Moz Pro
                        • Moz Local
                        • Moz API
                        • Moz Data
                        • STAT
                        • Product Updates
                        Moz Solutions
                        • SMB Solutions
                        • Agency Solutions
                        • Enterprise Solutions
                        • Digital Marketers
                        Free SEO Tools
                        • Domain Authority Checker
                        • Link Explorer
                        • Keyword Explorer
                        • Competitive Research
                        • Brand Authority Checker
                        • Local Citation Checker
                        • MozBar Extension
                        • MozCast
                        Resources
                        • Blog
                        • SEO Learning Center
                        • Help Hub
                        • Beginner's Guide to SEO
                        • How-to Guides
                        • Moz Academy
                        • API Docs
                        About Moz
                        • About
                        • Team
                        • Careers
                        • Contact
                        Why Moz
                        • Case Studies
                        • Testimonials
                        Get Involved
                        • Become an Affiliate
                        • MozCon
                        • Webinars
                        • Practical Marketer Series
                        • MozPod
                        Connect with us

                        Contact the Help team

                        Join our newsletter
                        Moz logo
                        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                        • Accessibility
                        • Terms of Use
                        • Privacy