The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. Site Crawl 4xx Errors?

    Site Crawl 4xx Errors?

    Moz Tools
    3 2 189
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mostcg
      mostcg last edited by

      Hello!

      When I check our website's critical crawler issues with Moz Site Crawler, I'm seeing over 1000 pages with a 4xx error.

      All of the pages that are showing to have a 4xx error appear to be the brand and product pages we have on our website, but with /URL at the end of each permalink.

      For example, we have a page on our site for a brand called Davinci. The URL is https://kannakart.com/davinci/. In the site crawler, I'm seeing the 4xx for this URL: https://kannakart.com/davinci/URL.

      Could this be a plugin on our site that is generating these URLs? If they're going to be an issue, I'd like to remove them. However, I'm not sure exactly where to begin.

      Thanks in advance for the help,

      -Andrew

      1 Reply Last reply Reply Quote 0
      • ThompsonPaul
        ThompsonPaul last edited by

        You have a defective link coded for the FAQ link in your site's footer, Andrew. It's currently coded as

        [Which then gets parsed as a relative link. This means the link gets parsed as www.example.com/currentpageurl/URL

        Because that link is in the sitewide footer, it means every page is generating that link as a link to itself with the /URL added to the end. Which you're seeing detected as all those 404s.

        This is very important to fix not only because the FAQ link is broken in the footer, but you've doubled the number of pages of the site for the search crawlers, meaning they're wasting time following thousands of useless links instead of focusing on real pages.

        So fortunately it's a quick fix - find that link in your footer template and correct it.

        Make sense?

        Paul](URL)

        mostcg 1 Reply Last reply Reply Quote 1
        • mostcg
          mostcg @ThompsonPaul last edited by

          Paul,

          Makes perfect sense. Thank you for the clear answer and explanation!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Crawl diagnostics up to date after Magento ecommerce site crawl?
            Whebb
            Whebb
            0
            2
            218

          • Having 1 page crawl error on 2 sites
            DavidLee
            DavidLee
            0
            4
            142

          • How do a run a MOZ crawl of my site before waiting for the scheduled weekly crawl?
            Kingalan1
            Kingalan1
            0
            6
            654

          • Question about Crawl Diagnostics - 4xx (Client Error) report
            fablau
            fablau
            0
            7
            436

          • How often does seomoz crawl the site? Can you force a crawl at a specific time ?
            stewbuch1872
            stewbuch1872
            0
            6
            188

          • Does Open Site Explorer purposefully not crawl some sites?
            KeriMorgret
            KeriMorgret
            0
            4
            281

          • 20000 site errors and 10000 pages crawled.
            Cyrus-Shepard
            Cyrus-Shepard
            0
            3
            709

          • Lots of site errors after last crawl....
            NoahsDad
            NoahsDad
            0
            5
            512

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy