The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How would you create and then segment a large sitemap?

    How would you create and then segment a large sitemap?

    Technical SEO Issues
    4 2 967
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SystemIDBarcodes
      SystemIDBarcodes last edited by

      I have a site with around 17,000 pages and would like to create a sitemap and then segment it into product categories.

      Is it best to create a map and then edit it in something like xmlSpy or is there a way to silo sitemap creation from the outset?

      1 Reply Last reply Reply Quote 0
      • Saijo.George
        Saijo.George last edited by

        If you site is structured such that the urls contain the categories you wish to sort , you can use something like Screaming Frog ( http://www.screamingfrog.co.uk/seo-spider/ ) and export all the urls and sort them out via excel in to categories and go that way

        NOTE : the free version has a 500 url limit, so you might want to look at paid ( ask them if it can handle 17,00 urls before getting it ) or look at http://home.snafu.de/tilman/xenulink.html ( I haven't used it myself , so don't know if you can export stuff to excel from there )

        Good luck mate , sounds like you have a big job ahead of you.

        SystemIDBarcodes 2 Replies Last reply Reply Quote 0
        • SystemIDBarcodes
          SystemIDBarcodes @Saijo.George last edited by

          To my knowledge, Screaming Frog doesn't allow you to create an XML sitemap. Perhaps Excel allows you to format the output from SF but I'm not sure. I did find a utility called XMLSpy which, though pricey, allows me to do some of the sorting I was looking for. Once sorted, I can manually pull out sections to segment my sitemap. It is a pain in the neck because I can determine a silo and do it automatically. That being said, I think I can develop a sitemap template and have our new web programmer to develop a way to auto generate a group of segmented sitemaps.

          Anyone know if there is a canned solution that works with IIS?

          1 Reply Last reply Reply Quote 0
          • SystemIDBarcodes
            SystemIDBarcodes @Saijo.George last edited by

            Thanks Saijo,

            We are trying to silo product types/categories and break them into different sitemaps. I'm familiar with SF but I don't think it will create sitemaps with the granularity that we are looking for.

            I'm using XMLSpy but I'm finding it hard to break out blocks of content.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Do I have to create a separate sitemap for my multilingual site?
              ReneAnton
              ReneAnton
              0
              3
              65

            • Technical guide for Setting up a CDN to host our images, as well as creating an image sitemap, and setting up the CDN in GWT?
              DmitriiK
              DmitriiK
              0
              4
              128

            • Sitemap
              Martijn_Scheijbeler
              Martijn_Scheijbeler
              0
              3
              69

            • Sitemap
              Leonie-Kramer
              Leonie-Kramer
              0
              5
              57

            • How to create site map for large site (ecommerce type) that has 1000's if not 100,000 of pages.
              Robin_Jennings
              Robin_Jennings
              0
              10
              9.5k

            • How could i create sitemap with 1000 page and should i update sitemap frequently?
              magician
              magician
              0
              4
              841

            • How can I best find out which URLs from large sitemaps aren't indexed?
              Audiohype
              Audiohype
              0
              4
              271

            • Which is the best way to create a sitemap for a mobile version of an online shop?
              0
              1
              502

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy