The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Should I worry about errors MozBot finds but is not on my sitemap?

    Should I worry about errors MozBot finds but is not on my sitemap?

    Technical SEO Issues
    3 3 466
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • 10JQKAs
      10JQKAs last edited by

      MozBot crawled a found a couple errors that isn't included on my sitemap plugin, such as duplicate page content on author pages.

      Should I worry about things not on my sitemap?

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        Whether a page is or is not included in your sitemap is irrelevant. Search engines will perform a normal crawl of your site based on the navigation and links for your site. If any page on your site can be reached from any navigation or link on your site, then search engines can find it.

        If the page is not marked with a noindex tag, then search engines may attempt to index the page which would cause a duplicate content issue.

        A common cause of duplicate content issues on author pages is caused by a lack of information. An author who has provided a detailed bio produces a nice author page, but other authors may share the absolutely minimum amount of information required by your site to publish, and if there is no content other then a user name that would cause a duplicate content issue.

        The preferable solution would be to gather more information from authors. Name, email, social accounts, location, areas of expertise, interests, credentials, etc. If you are unable to do such you can also noindex the pages for those authors.

        1 Reply Last reply Reply Quote 2
        • AlanMosley
          AlanMosley last edited by

          Yes, I would fix every thing that is or could be a problem, it is hard to rank, and you dont weant anything working aginst you.

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Sitemap generator partially finding list of website URLs
            Taysir
            Taysir
            0
            6
            65

          • Hi My website is showing 403 error. Please help me to find out the reason
            RobCairns
            RobCairns
            0
            2
            223

          • We are fixing broken links - can anyone tell me how to find and correct these errors
            ApWeb
            ApWeb
            0
            7
            344

          • Sitemap errors have disappeared from my Google Webmaster tools
            SMVSEO
            SMVSEO
            0
            3
            147

          • Sitemap issue - Tons of 404 errors
            JanetJ
            JanetJ
            0
            7
            140

          • I have a 404 error on my site i can't find.
            NateStewart
            NateStewart
            0
            7
            324

          • My sitemap in Google is coming back with an error
            ThompsonPaul
            ThompsonPaul
            0
            8
            194

          • How to find local search engines in all countries to submit sitemap?
            KeriMorgret
            KeriMorgret
            0
            2
            817

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy