The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How to visualize our entire site to discover the origin of URLs?

    How to visualize our entire site to discover the origin of URLs?

    Technical SEO Issues
    7 3 765
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • poolguy
      poolguy last edited by

      What is a tool to use so that I can visualize all links to all pages on the site so that I can discover how certain duplicate content URLs are being created?

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        If you set up a SEOmoz campaign, the web crawl report will offer that information. If not, you can request your site to be crawled: http://pro.seomoz.org/tools/crawl-test

        poolguy 1 Reply Last reply Reply Quote 0
        • poolguy
          poolguy @RyanKent last edited by

          What if I need 150k pages crawled, rather than 20k?

          RyanKent poolguy 3 Replies Last reply Reply Quote 0
          • RyanKent
            RyanKent @poolguy last edited by

            I believe this tool will meet your needs.

            1 Reply Last reply Reply Quote 0
            • poolguy
              poolguy @poolguy last edited by

              Yea, I've seen that before.  Will that show me how unwanted pages are being referenced?

              1 Reply Last reply Reply Quote 0
              • RyanKent
                RyanKent @poolguy last edited by

                I have not used the tool in quite some time but if I recall correctly it does offer a referring page URL. I can't imagine it would be useful without that information.

                1 Reply Last reply Reply Quote 1
                • magicrob
                  magicrob last edited by

                  SEO Spider from Screaming Frog is a great crawler and a notable alternative to Xenu

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • URLs too long, but run an eCommerce site
                    effectdigital
                    effectdigital
                    1
                    3
                    68

                  • Changing site URL structure
                    vezaus
                    vezaus
                    0
                    2
                    80

                  • Switching site from http to https. Should I do entire site?
                    rayvensoft
                    rayvensoft
                    1
                    5
                    592

                  • Canonical URLs in an eCommerce site
                    Gabriele_Layoutweb
                    Gabriele_Layoutweb
                    0
                    4
                    208

                  • Will sitemap generated in Yoast for a combined wordpress/magento site map entire site ?
                    Dan-Lawrence
                    Dan-Lawrence
                    0
                    5
                    1.4k

                  • How to find original URLS after Hosting Company added canonical URLs, URL rewrites and duplicate content.
                    Nobody1560986989723
                    Nobody1560986989723
                    0
                    2
                    366

                  • Does 301 redirecting a site multiple times keep the value of the original site?
                    debi_zyx
                    debi_zyx
                    0
                    3
                    692

                  • Will 301 redirecting a site multiple times still preserve the original site value?
                    JoeAmadon
                    JoeAmadon
                    0
                    2
                    588

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy