The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Can we add sites to the crawl queue for OSE?

    Can we add sites to the crawl queue for OSE?

    Moz Tools
    6 4 344
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • eseyo
      eseyo last edited by

      Is it possible to request that Open Site Explorer crawls a new URL on its next run?

      This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating.

      I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool.

      It would make sense that OSE crawls the sites that Moz members are working on wouldnt it?

      Scott.

      1 Reply Last reply Reply Quote 0
      • CMC-SD
        CMC-SD last edited by

        As far as I know, crawling your website wouldn't accomplish anything. OSE would need to crawl the pages that link to your website. And if you knew what those were, you wouldn't need OSE, right? 🙂

        eseyo 1 Reply Last reply Reply Quote 0
        • eseyo
          eseyo @CMC-SD last edited by

          Yes I know what you mean here, but if there is any way to "point" the crawl engine at the site and ask it what it knows?

          I hadnt thought about it from that perspective, just asking the question to see what is possible to try and get more data if it can be got?!

          CMC-SD 1 Reply Last reply Reply Quote 0
          • TheSEODR
            TheSEODR last edited by

            SeoMoz members have no control over what Mozbot crawls. Your best bet is to use a variety of site explorers to find links. Ex. Majestic, Google Webmaster tools, Link:www.example.com, Bing Link Explorer

            1 Reply Last reply Reply Quote 1
            • CMC-SD
              CMC-SD @eseyo last edited by

              You "ask it what it knows" when you type in a URL and hit Search. Think of it like walking up to a really smart person and asking them to list off every book every written that includes the word "rhinoceros." They can only list the books they've read. A person only has so much time for reading, and OSE only has so many resources for crawling the web. It will never get everything.

              If OSE doesn't show any backlinks for a URL, it means it didn't see any backlinks in the portion of the web that it crawled. That might mean there are no backlinks at all, or it might mean the backlinks are yet undiscovered (probably because they're in an obscure corner of the web). The best suggestion is to use multiple tools, as Derek says below.

              1 Reply Last reply Reply Quote 0
              • JoelDay
                JoelDay last edited by

                Hi Scott,

                Derek and Brad are correct in that there's no real way to tell Roger to index a specific page.

                Your best bet to get your page index in OSE is to work at building quality backlinks and making sure your site is configured properly so we can reach your pages.

                Also remember you can set up your campaign for your site and crawl it that way if you want to evaluate the rest of your page information.

                I hope that helps.
                Cheers,
                Joel.

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • Site redesign makes Moz Site Crawl go haywire
                  mrtemper
                  mrtemper
                  1
                  2
                  19

                • Does anyone know the linking of hashtags on Wix sites does it negatively or postively impact SEO. It is coming up as an error in site crawls 'Pages with 404 errors' Anyone got any experience please?
                  Nozzle
                  Nozzle
                  0
                  5
                  82

                • Crawl diagnostics up to date after Magento ecommerce site crawl?
                  Whebb
                  Whebb
                  0
                  2
                  218

                • How do a run a MOZ crawl of my site before waiting for the scheduled weekly crawl?
                  Kingalan1
                  Kingalan1
                  0
                  6
                  654

                • Why would my site return an error when using Open Site Explorer to crawl it?
                  KeriMorgret
                  KeriMorgret
                  0
                  5
                  183

                • Site Redesign Launch - How Can I crawl for immediate review
                  KeriMorgret
                  KeriMorgret
                  0
                  3
                  253

                • I put a crawl on my site via seomoz and has come back saying only 1 page has been crawled.It has been over a week now can anyone help?
                  jaytwotwenty
                  jaytwotwenty
                  0
                  3
                  739

                • My website has 18500 pages but my SEO MOZ campaign is limited to a 10,000 page crawl. How can I get the other 8500 pages crawled? Can I use one of my 3 spare campaigns?
                  kenneth_martin
                  kenneth_martin
                  0
                  5
                  1.0k

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy