The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. I've had a sudden a increase in crawl issues as of yesterday (like 300 from a steady 10, does anyone else have this issue?

    I've had a sudden a increase in crawl issues as of yesterday (like 300 from a steady 10, does anyone else have this issue?

    Technical SEO Issues
    5 4 120
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • beckyhy
      beckyhy last edited by

      the main issue is that it's now indexing both www and http://  - anyone else got this issue or had any changes suddenly on their crawl results?

      1 Reply Last reply Reply Quote 0
      • RyanPurkey
        RyanPurkey last edited by

        Hi Rebecca. Do you have a 301 redirect in place to set your preferred domain? i.e. If someone goes to http:// are they redirected to the www, vice versa, or do both work? If both work you could get crawling on both versions. Ideally you'll pick your preferred setup, add the 301, and also set that same preference within GWT and Bing.

        1 Reply Last reply Reply Quote 0
        • Fuel
          Fuel last edited by

          My first response was going to be just what Ryan suggested!

          I would look into why both are being indexed, which could be as simple as needing to redirect one version to the other, and then change your preferences in GWT & Bing. The issue should sort itself out after that has been taken care of.

          1 Reply Last reply Reply Quote 0
          • beckyhy
            beckyhy last edited by

            Thank you both. I was wondering why it had done this now (the domain is at least 4 years old) but i'm going to do what you say and hope it fixes so thanks again!

            MattRoney 1 Reply Last reply Reply Quote 0
            • MattRoney
              MattRoney @beckyhy last edited by

              If it makes things easier, based on your settings in that campaign you've always been crawling "all sites," including http://domain.com and http://www.domain.com. If this is due to a redirect, I'd guess that it's due to a redirect having been removed.

              Have there been any changes made on that site recently?

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • I'm struggling to understand (and fix) why I'm getting a 404 error. The URL includes this "%5Bnull%20id=43484%5D" but I cannot find that anywhere in the referring URL. Does anyone know why please? Thanks
                Nichole.wynter2020
                Nichole.wynter2020
                0
                3
                28

              • Increase in Crawl Errors
                abisti2
                abisti2
                0
                5
                80

              • Sitemap issue? 404's & 500's are regenerating?
                jeff-rackaid.com
                jeff-rackaid.com
                0
                5
                263

              • Crawling issues in google
                CMTM
                CMTM
                0
                4
                258

              • What's the issue?
                jasarrow
                jasarrow
                0
                5
                402

              • How to increase the crawl rate?
                greyniumseo
                greyniumseo
                0
                3
                675

              • Issue with 'Crawl Errors' in Webmaster Tools
                RiceMedia
                RiceMedia
                0
                4
                782

              • Crawl issues/ .htacess issues
                StalkerB
                StalkerB
                0
                6
                1.1k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy