The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How would you create and then segment a large sitemap?

    How would you create and then segment a large sitemap?

    Technical SEO Issues
    4 2 967
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SystemIDBarcodes
      SystemIDBarcodes last edited by

      I have a site with around 17,000 pages and would like to create a sitemap and then segment it into product categories.

      Is it best to create a map and then edit it in something like xmlSpy or is there a way to silo sitemap creation from the outset?

      1 Reply Last reply Reply Quote 0
      • Saijo.George
        Saijo.George last edited by

        If you site is structured such that the urls contain the categories you wish to sort , you can use something like Screaming Frog ( http://www.screamingfrog.co.uk/seo-spider/ ) and export all the urls and sort them out via excel in to categories and go that way

        NOTE : the free version has a 500 url limit, so you might want to look at paid ( ask them if it can handle 17,00 urls before getting it ) or look at http://home.snafu.de/tilman/xenulink.html ( I haven't used it myself , so don't know if you can export stuff to excel from there )

        Good luck mate , sounds like you have a big job ahead of you.

        SystemIDBarcodes 2 Replies Last reply Reply Quote 0
        • SystemIDBarcodes
          SystemIDBarcodes @Saijo.George last edited by

          To my knowledge, Screaming Frog doesn't allow you to create an XML sitemap. Perhaps Excel allows you to format the output from SF but I'm not sure. I did find a utility called XMLSpy which, though pricey, allows me to do some of the sorting I was looking for. Once sorted, I can manually pull out sections to segment my sitemap. It is a pain in the neck because I can determine a silo and do it automatically. That being said, I think I can develop a sitemap template and have our new web programmer to develop a way to auto generate a group of segmented sitemaps.

          Anyone know if there is a canned solution that works with IIS?

          1 Reply Last reply Reply Quote 0
          • SystemIDBarcodes
            SystemIDBarcodes @Saijo.George last edited by

            Thanks Saijo,

            We are trying to silo product types/categories and break them into different sitemaps. I'm familiar with SF but I don't think it will create sitemaps with the granularity that we are looking for.

            I'm using XMLSpy but I'm finding it hard to break out blocks of content.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Sitemap use for very large forum-based community site
              GFD_Chris
              GFD_Chris
              0
              3
              59

            • Do I have to create a separate sitemap for my multilingual site?
              ReneAnton
              ReneAnton
              0
              3
              65

            • How to manually create sitemap with 301 redirrctions?
              donford
              donford
              0
              2
              181

            • What is the best program to create an html sitemap?
              ntsupply
              ntsupply
              0
              4
              1.5k

            • Why my images are not getting indexed, even though I have created image sitemap?
              DirkC
              DirkC
              0
              10
              1.3k

            • How could i create sitemap with 1000 page and should i update sitemap frequently?
              magician
              magician
              0
              4
              841

            • How do I create a Video Sitemap for Youtube Embedded Videos?
              Hakkasan
              Hakkasan
              1
              4
              2.4k

            • Segmenting Website into XML Sitemaps
              wissamdandan
              wissamdandan
              0
              2
              917

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy