The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Link Explorer
    4. Crawling and Links - Showing Links

    Crawling and Links - Showing Links

    Link Explorer
    2 2 118
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • wearehappymedia
      wearehappymedia last edited by

      Hello

      I have a campaign in Moz that shows a new site as having no domain authority and no links.

      The site does have links to it, but they don't show up on OSE.

      Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link.

      What is the best way to see the links the site has?

      Thanks!

      1 Reply Last reply Reply Quote 1
      • ChiarynMiranda
        ChiarynMiranda last edited by

        Hey Radi,

        The link metrics section of your campaign pulls from our Mozscape index, which updates about once a month.

        Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.

        Just so you know, here's how we compile our index:

        • We grab the most recent index
        • We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains)
        • We start crawling from the top down until we've crawled 180,000,000,000 pages (which is about 35% the amount in Google's index)

        Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update), then it won't show up in our index.

        We update our Mozscape Index every 4-8 weeks. Crawling the entire Internet to look for links takes ~2-4 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing, which can take up to 3 weeks to determine which of those links are the most important.

        Mozscape focuses on a breadth-first approach. This means that we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. But deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates until we catch all of these.

        If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked to by other documents on the web, or our index will not include them.

        I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see them in OSE next month!

        1 Reply Last reply Reply Quote 2
        • 1 / 1
        • First post
          Last post
        • Why are my trackable links appearing in my site crawls?
          eli.myers
          eli.myers
          0
          2
          19

        • Link explorer section showing different linking domains numbers
          samantha.chapman
          samantha.chapman
          0
          3
          57

        • Why Moz Link Explorer is showing wrong data?
          eli.myers
          eli.myers
          0
          2
          56

        • My site links to my clients not showing in Moz
          tawnycase
          tawnycase
          0
          2
          94

        • Why isn't OSE showing any of my links?
          DanDeceuster
          DanDeceuster
          0
          5
          272

        • Why are none of the links we've received from press and other sources from the last two months showing on our Inbound Links in OSE???
          TVape
          TVape
          0
          10
          323

        • My linked in profile is showing up the opensite exploer but not showing up in on page grader, any ideas why? the onpage grader says in url is in accessible
          DavidLee
          DavidLee
          0
          2
          79

        • OpenSiteExplorer is showing all link root domains or not?
          GPainter
          GPainter
          0
          4
          184

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy