The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Sitemap generator which only includes canonical urls

    Sitemap generator which only includes canonical urls

    Intermediate & Advanced SEO
    2 2 765
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • recbrands
      recbrands last edited by

      Does anyone know of a 3rd party sitemap generator that will only include the canonical url's?  Creating a sitemap with geo and sorting based parameters isn't the most ideal way to generate sitemaps.  Please let me know if anyone has any ideas.  Mind you we have hundreds of thousands of indexed url's and this can't be done with a simple text editor.

      1 Reply Last reply Reply Quote 0
      • DirkC
        DirkC last edited by

        You can use Screaming Frog for this (and much more). It's not free but is great tool to check the SEO health of your site as well.
        Trial is free (up to 500 url's).
        To generate the sitemap - crawl  your site with following settings:
        Configuration > Spider > Advanced tab: select:

        • always follow redirects
        • respect noindex
        • respect canonical

        After crawl - under the Sitemaps you can create the XML & image sitemaps.

        Dirk

        1 Reply Last reply Reply Quote 3
        • 1 / 1
        • First post
          Last post
        • For a sitemap.html page, does the URL slug have to be /sitemap?
          ThompsonPaul
          ThompsonPaul
          0
          4
          205

        • Client wants to remove mobile URLs from their sitemap to avoid indexing issues. However this will require SEVERAL billing hours. Is having both mobile/desktop URLs in a sitemap really that detrimental to search indexing?
          RosemaryB
          RosemaryB
          0
          7
          89

        • We 410'ed URLs to decrease URLs submitted and increase crawl rate, but dynamically generated sub URLs from pagination are showing as 404s. Should we 410 these sub URLs?
          jeffchen
          jeffchen
          0
          3
          189

        • Xml sitemap Issue... Xml sitemap generator facilitating only few pages for indexing
          Paddy_Moogan
          Paddy_Moogan
          0
          6
          153

        • Multiple Sitemaps Vs One Sitemap and Why 500 URLs?
          Leonie-Kramer
          Leonie-Kramer
          0
          2
          270

        • Canonical URL & sitemap URL mismatch
          LynnPatchett
          LynnPatchett
          0
          2
          612

        • 301 forwarding old urls to new urls - when should you update sitemap?
          crackingmedia
          crackingmedia
          0
          4
          2.1k

        • If I can't list my canonical URLs in my sitemap, will I be creating duplicate content?
          emilyburns
          emilyburns
          0
          3
          2.2k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy