The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Why xml generator is not detecting all my urls?

    Why xml generator is not detecting all my urls?

    Technical SEO Issues
    4 3 81
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Ideas-Money-Art
      Ideas-Money-Art last edited by

      Hi Mozzers,

      After adding 3 new pages to example.com, when generating the xml sitemap,  Iwasn't able to locate those 3 new url. This is the first time it is happening. I have checked the meta tags of these pages and they are fine. No meta robots setup!

      Any thoughts or idea why this is happening? how to fix this?

      Thanks!

      1 Reply Last reply Reply Quote 0
      • MattAntonino
        MattAntonino last edited by

        Are they linked to a page that the crawler can find?

        What are you generating it with?  Online tools like xml-sitemaps.com act like a spider - if they can't crawl from the homepage to the new page, they simply won't find it.

        Internal tools, like a Wordpress plugin, should actually find those orphan pages.

        1 Reply Last reply Reply Quote 2
        • Martijn_Scheijbeler
          Martijn_Scheijbeler last edited by

          Like Matt says, could it be that there is a robots.txt file that could block these URLs? Could it be that your XML sitemap generator is using cached results for your site. Can the pages be found on the page via links on other pages?

          1 Reply Last reply Reply Quote 1
          • Ideas-Money-Art
            Ideas-Money-Art last edited by

            Thank you Guys!

            I resolved the issue! I think it was a caching issue!

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Generating a xml sitemap?
              JVRudnick
              JVRudnick
              1
              4
              128

            • Add selective URLs to an XML Sitemap
              AB_Newbie
              AB_Newbie
              0
              7
              230

            • Does the order of urls in an xml sitemap matter?
              irvingw
              irvingw
              0
              2
              3.3k

            • Removing Redirected URLs from XML Sitemap
              Travis-W
              Travis-W
              0
              2
              2.6k

            • Omitting URLs from XML Sitemap - Bad??
              Cyrus-Shepard
              Cyrus-Shepard
              0
              6
              1.2k

            • Best XML Sitemap Generator for Mac?
              markadoi84
              markadoi84
              0
              4
              9.3k

            • How to generate a visual sitemap using sitemap.xml
              Churchill1
              Churchill1
              0
              3
              8.4k

            • Best XML Sitemap generator
              suparno
              suparno
              0
              10
              7.6k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy