The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Can we add sites to the crawl queue for OSE?

    Can we add sites to the crawl queue for OSE?

    Moz Tools
    6 4 344
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • eseyo
      eseyo last edited by

      Is it possible to request that Open Site Explorer crawls a new URL on its next run?

      This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating.

      I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool.

      It would make sense that OSE crawls the sites that Moz members are working on wouldnt it?

      Scott.

      1 Reply Last reply Reply Quote 0
      • CMC-SD
        CMC-SD last edited by

        As far as I know, crawling your website wouldn't accomplish anything. OSE would need to crawl the pages that link to your website. And if you knew what those were, you wouldn't need OSE, right? 🙂

        eseyo 1 Reply Last reply Reply Quote 0
        • eseyo
          eseyo @CMC-SD last edited by

          Yes I know what you mean here, but if there is any way to "point" the crawl engine at the site and ask it what it knows?

          I hadnt thought about it from that perspective, just asking the question to see what is possible to try and get more data if it can be got?!

          CMC-SD 1 Reply Last reply Reply Quote 0
          • TheSEODR
            TheSEODR last edited by

            SeoMoz members have no control over what Mozbot crawls. Your best bet is to use a variety of site explorers to find links. Ex. Majestic, Google Webmaster tools, Link:www.example.com, Bing Link Explorer

            1 Reply Last reply Reply Quote 1
            • CMC-SD
              CMC-SD @eseyo last edited by

              You "ask it what it knows" when you type in a URL and hit Search. Think of it like walking up to a really smart person and asking them to list off every book every written that includes the word "rhinoceros." They can only list the books they've read. A person only has so much time for reading, and OSE only has so many resources for crawling the web. It will never get everything.

              If OSE doesn't show any backlinks for a URL, it means it didn't see any backlinks in the portion of the web that it crawled. That might mean there are no backlinks at all, or it might mean the backlinks are yet undiscovered (probably because they're in an obscure corner of the web). The best suggestion is to use multiple tools, as Derek says below.

              1 Reply Last reply Reply Quote 0
              • JoelDay
                JoelDay last edited by

                Hi Scott,

                Derek and Brad are correct in that there's no real way to tell Roger to index a specific page.

                Your best bet to get your page index in OSE is to work at building quality backlinks and making sure your site is configured properly so we can reach your pages.

                Also remember you can set up your campaign for your site and crawl it that way if you want to evaluate the rest of your page information.

                I hope that helps.
                Cheers,
                Joel.

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Does anyone know the linking of hashtags on Wix sites does it negatively or postively impact SEO. It is coming up as an error in site crawls 'Pages with 404 errors' Anyone got any experience please?
                  Nozzle
                  Nozzle
                  0
                  5
                  82

                • Can someone kindly explain what 'Crawl Issue Found: No rel="canonical" Tags' means? Is this a critical error and how can it be rectified?
                  KevinBudzynski
                  KevinBudzynski
                  0
                  2
                  174

                • Crawl diagnostics up to date after Magento ecommerce site crawl?
                  Whebb
                  Whebb
                  0
                  2
                  218

                • Seo moz has only crawled 2 pages of my site. Ive been notified of a 403 error and need an answer as to why my pages are not being crawled?
                  nitro-digital
                  nitro-digital
                  0
                  9
                  319

                • Why would my site return an error when using Open Site Explorer to crawl it?
                  KeriMorgret
                  KeriMorgret
                  0
                  5
                  183

                • Does Open Site Explorer purposefully not crawl some sites?
                  KeriMorgret
                  KeriMorgret
                  0
                  4
                  281

                • SEOMOZ Crawling Our Site
                  AdamThompson
                  AdamThompson
                  0
                  7
                  356

                • How can I get a report of the top 500 national sites using Domain Authority and Page Authority? Does someone have to type sites in one by one on Site Explorer or is there another way?
                  kyleNeedham
                  kyleNeedham
                  0
                  2
                  545

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy