The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Crawl Rate for Lower Page Authority Websites

    Crawl Rate for Lower Page Authority Websites

    Moz Tools
    2 2 1.3k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Thumbtack
      Thumbtack last edited by

      Hi,At thumbtack.com we get tons of links from low (or no) page authority websites, and I'm wondering what the crawl rate of those links looks like.  I know Google pulls in the web at an astonishing rate, but I'd imagine they aren't re-crawling lower PA very frequently.Are they discovering these links a week after they're posted?  A month?  More?  I spent a while looking around for histograms of actual crawl rates and found surprisingly little.  I'd love to see average crawl rate by Domain or Page Authority if that exists anywhere.
      Thanks!-MichaelP.S.  Here are some random examples of the types of pages with inbound links I'm talking about.  Normally we wouldn't spend too much time thinking about these, but there's just so many of them we can't ignore it!- http://www.majestic-cleaners.webs.com/- http://domchieraphotography.blogspot.com/- http://charlottepiano.musicteachershelper.com/- http://pin-upgirlphotography.vpweb.com/default.html- http://jfaithful.weebly.com/

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        I have a site that is 4 months old. Prior to today the site had a domain authority of 0, and the home page had a PA of 1. I submitted a daily sitemap and the site was crawled daily. If I ever shared an important article I would submit an extra site map and noticed the content in the search results within a couple hours. This is an active, forum based site.

        I have heard others complain their site is crawled very infrequently. I am not sure if Google treated my site well because it was newer, or had good content, or decent activity. I can just share my experience that the site was crawled quite frequently.

        Just checking the first site, it has only a few pages. It was designed by a basic site creation software and seems crawlable. Just small sites (around 10 pages) don't change frequently so they don't get crawled often. If the site owner doesn't submit a sitemap letting Google know a change has been made, it may be some time before Google decides to crawl them or finds a link to their site.

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Why doesn't Moz crawl whole pages of our website to report All On-Page issues?
          BigSlate
          BigSlate
          0
          3
          65

        • Page Authority and Google updates favouring websites with black hat practices ?
          DennisSeymour
          DennisSeymour
          0
          3
          112

        • Have a Campaign, but only states 1 page has been crawled by SEOmoz bots. What needs to be done to have all the pages crawled?
          Johnny4B
          Johnny4B
          0
          4
          147

        • Only few pages (308 pages of 1000 something pages) have been crawled and diagnosed in 4 days, how many days till the entire website is crawled complete?
          DarinPirkey
          DarinPirkey
          0
          4
          288

        • Links & page authority crawl
          nazmiyal
          nazmiyal
          0
          5
          482

        • Why There is no Page Authority in none of my websites?
          GroupM
          GroupM
          0
          4
          686

        • No Data for Linking Root Domains and Page Authority For Website Ranking #1
          annasus
          annasus
          0
          4
          531

        • How do I get the Page Authority of individual URLs in my exported (CSV) crawl reports?
          Twilio
          Twilio
          0
          3
          740

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy