The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Huge number of crawl anomalies and 404s - non- existent urls

    Huge number of crawl anomalies and 404s - non- existent urls

    Technical SEO Issues
    6 2 130
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • nicola-1
      nicola-1 last edited by

      Hi there,

      Our site was redesigned at the end of January 2020. Since the new site was launched we have seen a big drop in impressions (50-60%) and also a big drop in total and organic traffic (again 50-60%) when compared to the old site.

      I know in the current climate some businesses will see a drop in traffic, however we are a tech business and some of our core search terms have increased in search volume as a result of remote-working.

      According to search console there are 82k urls excluded from coverage - the majority of these are classed as 'crawl anomaly' and there are 250+ 404's - almost all of the urls are non-existent, they have our root domain with a string of random characters on the end. Here are a couple of examples:

      root.domain.com/96jumblestorebb42a1c2320800306682

      root.domain.com/01sportsplazac9a3c52miz-63jth601

      root.domain.com/39autoparts-agency26be7ff420582220

      root.domain.com/05open-kitchenaf69a7a29510363

      Is this a cause for concern? I'm thinking that all of these random fake urls could be preventing genuine pages from being indexed / or they could be having an impact on our search visibility. Can somebody advise please?

      Thanks!

      1 Reply Last reply Reply Quote 0
      • GFD_Chris
        GFD_Chris last edited by

        From what I can tell, this probably isn't the reasons for the drops. I'd go back and ensure that any URLs that changed are 301 redirecting to the correct destination URL. I'd also ensure that no pages that were associated with high volume keywords no longer exist.

        For your issue, Google is likely finding some broken URLs, possibly from your internal linking structure. Perform a crawl of the site and see if you can find "Inlinks" to those broken pages. If so, you can work with dev to eliminate the issue.

        1 Reply Last reply Reply Quote 0
        • nicola-1
          nicola-1 last edited by

          Thanks for your reply, would broken urls from the internal linking structure explain the random characters? e.g. root.domain.com/96jumblestorebb42a1c2320800306682

          We've never had any page content/urls relating to 'jumblestore'.

          Thanks!

          1 Reply Last reply Reply Quote 0
          • GFD_Chris
            GFD_Chris last edited by

            It's tough to say without seeing the site. Overall it's unlikely if you don't use that string anywhere. We usually see it more for broken relative URLs. Maybe a third party site is using that string.

            1 Reply Last reply Reply Quote 0
            • nicola-1
              nicola-1 last edited by

              Thanks for your reply.

              I’m new to the business and I’ve found that that the old website had a spam attack, all of these fake urls are from the old pages (as they have 301s).

              There are 82,000 crawl anomalies from these fake/spam URLs and around 200 404s. None of the fake /spam urls have been indexed. Could this be having a negative effect of search visibility/DA or rankings?

              Thanks!

              1 Reply Last reply Reply Quote 0
              • GFD_Chris
                GFD_Chris last edited by

                Unlikely, as long as they're returning 404 errors you should be OK. Maybe update your disavow file and you should be good to go!

                1 Reply Last reply Reply Quote 1
                • 1 / 1
                • First post
                  Last post
                • What to do with existing URL when replatforming and new URL is the same?
                  GPainter
                  GPainter
                  0
                  4
                  37

                • Google tries to index non existing language URLs. Why?
                  NickSamuel
                  NickSamuel
                  0
                  2
                  34

                • Submitted URL has crawl issue - Submitted URL seems to be a Soft 404 - but all looks fine
                  JohnSammon
                  JohnSammon
                  0
                  2
                  56

                • Use existing page with bad URL or brand new URL?
                  XLMarketing
                  XLMarketing
                  0
                  5
                  47

                • 404s effecting crawl rate?
                  DennisSeymour
                  DennisSeymour
                  0
                  4
                  126

                • Crawl reveals hundreds of urls with multiple urls in the url string
                  irvingw
                  irvingw
                  0
                  5
                  455

                • Why the number of crawled pages is so low¿?
                  Cyrus-Shepard
                  Cyrus-Shepard
                  0
                  8
                  502

                • Canonical for non-exist URL ?
                  Theo-NL
                  Theo-NL
                  0
                  2
                  738

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy