The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. How do i get the crawler going again?

    How do i get the crawler going again?

    Moz Tools
    6 3 194
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • martJ
      martJ last edited by

      The initial crawl only hit one page. Set up another campaign for another site and it crawled 260 pages.

      How can I get the crawler started up again or do I really have to wait a week ?

      1 Reply Last reply Reply Quote 0
      • martJ
        martJ last edited by

        Research Tools > Crawl Test at bottom left of page.

        Not sure why it's taken me 2 days to find that but it did.

        Thanks. Sorry for the dumb question...

        josh-riley 1 Reply Last reply Reply Quote 1
        • josh-riley
          josh-riley @martJ last edited by

          Whenever you have crawl issues, the SEOMoz help team is the place to go. They're the only ones who can look into your account to see if there's an issue or such. (And they are really nice and quick to respond.)

          KeriMorgret 1 Reply Last reply Reply Quote 2
          • KeriMorgret
            KeriMorgret @josh-riley last edited by

            Also, for why we only crawled one page, check out  https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages- for some helpful tips.

            martJ 1 Reply Last reply Reply Quote 0
            • martJ
              martJ @KeriMorgret last edited by

              Hi Keri,

              Yeah, I've followed these steps. htaccess forwards to www if none and my campaign is using www.

              The robots.txt is available in browser no problem.

              my htaccess had massive country ip blocks as well as amazonaws..

              I've removed all blocks that arent china or amazon.

              Still waiting on a response from the MOZ team here on how to get the real crawl going as what I found in tools is not the same as the weekly scan.

              KeriMorgret 1 Reply Last reply Reply Quote 0
              • KeriMorgret
                KeriMorgret @martJ last edited by

                It's easiest for the Moz team to respond to individual questions like this via an email to help@seomoz.org or sending in a ticket through the help hub at seomoz.org/help.

                1 Reply Last reply Reply Quote 1
                • 1 / 1
                • First post
                  Last post
                • How to get free backlink?
                  Chris.Menke
                  Chris.Menke
                  0
                  2
                  81

                • MOZ Crawler
                  samantha.chapman
                  samantha.chapman
                  0
                  3
                  78

                • Getting thousands of errors in Crawl Diagnostics after changing website structure. Is there a problem with the crawler?
                  Tiberiu
                  Tiberiu
                  0
                  5
                  246

                • Reset Crawler
                  MeganSingley
                  MeganSingley
                  0
                  4
                  288

                • Rogerbot getting cheeky?
                  MeganSingley
                  MeganSingley
                  1
                  4
                  1.4k

                • I go crazy!
                  Marcus_Miller
                  Marcus_Miller
                  0
                  2
                  438

                • What do you get with mozpoints?
                  NakulGoyal
                  NakulGoyal
                  0
                  7
                  537

                • How do I get my crawl report?
                  Getz.pro
                  Getz.pro
                  0
                  3
                  676

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy