The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. What is the best tool for getting a SiteMap url for a website with over 4k pages?

    What is the best tool for getting a SiteMap url for a website with over 4k pages?

    Technical SEO Issues
    4 4 58
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DanKellyCockroach
      DanKellyCockroach last edited by

      I have just migrated my website from HUGO to Wordpress and I want to submit the sitemap to Google Search Console (because I haven't done so in a couple years). It looks like there are many tools for getting a sitemap file built. But I think they probably vary in quality. Especially considering the size of my site.

      1 Reply Last reply Reply Quote 2
      • Kenn_Gold
        Kenn_Gold last edited by

        We use Screaming Frog and we are about 80k pages.

        1 Reply Last reply Reply Quote 3
        • jasongmcmahon
          jasongmcmahon last edited by

          As Keen already stated, Screaming From is the best option

          1 Reply Last reply Reply Quote 1
          • effectdigital
            effectdigital last edited by

            Screaming Frog is good for crawling an existing Sitemap.xml file and can indeed produce Sitemap.xml files, but if our site is medium-sized (thousands of URLs) then really you'd want a dynamic one. Pretty sure the Yoast SEO plugin for WordPress has this built in with some tweak options and variables, probably start there

            With Screaming Frog you'd have to keep manually re-building your sitemap XML / XML index file. Sounds pointless, boring and tedious when relatively stable dynamic options exist

            1 Reply Last reply Reply Quote 3
            • 1 / 1
            • First post
              Last post
            • SEO URLs: 1\. URLs in my language (Greek, Greeklish or English)? 2\. Αt the end it is good to put -> .html? What is the best way to get great ranking?
              marioskal
              marioskal
              0
              7
              662

            • Hi, we are wanting to test a new version of one particular page on our website. What's the best way to run a test for a week without harming rankings. Do we use a 302 redirect or direct 100% of traffic using a tool like Optimizely?
              WebElaine
              WebElaine
              0
              2
              33

            • Canonical sitemap URL different to website URL architecture
              StephanSolomonidis
              StephanSolomonidis
              0
              3
              105

            • My website internal pages are not getting cached with latest data
              evolvingSEO
              evolvingSEO
              0
              2
              241

            • My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Please advise.
              Vuly
              Vuly
              0
              5
              1.6k

            • Which are the best website reporting tools for speed and errors
              ClaireH-184886
              ClaireH-184886
              0
              6
              423

            • Why do I get duplicate pages, website referencing the capital version of the url vs the lowercase www.agi-automation.com/Pneumatic-grippers.htm
              TimKelsey
              TimKelsey
              0
              7
              547

            • Sitemap for dynamic website with over 10,000 pages
              ASOS
              ASOS
              0
              5
              3.5k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy