The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How to visualize our entire site to discover the origin of URLs?

    How to visualize our entire site to discover the origin of URLs?

    Technical SEO Issues
    7 3 765
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • poolguy
      poolguy last edited by

      What is a tool to use so that I can visualize all links to all pages on the site so that I can discover how certain duplicate content URLs are being created?

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        If you set up a SEOmoz campaign, the web crawl report will offer that information. If not, you can request your site to be crawled: http://pro.seomoz.org/tools/crawl-test

        poolguy 1 Reply Last reply Reply Quote 0
        • poolguy
          poolguy @RyanKent last edited by

          What if I need 150k pages crawled, rather than 20k?

          RyanKent poolguy 3 Replies Last reply Reply Quote 0
          • RyanKent
            RyanKent @poolguy last edited by

            I believe this tool will meet your needs.

            1 Reply Last reply Reply Quote 0
            • poolguy
              poolguy @poolguy last edited by

              Yea, I've seen that before.  Will that show me how unwanted pages are being referenced?

              1 Reply Last reply Reply Quote 0
              • RyanKent
                RyanKent @poolguy last edited by

                I have not used the tool in quite some time but if I recall correctly it does offer a referring page URL. I can't imagine it would be useful without that information.

                1 Reply Last reply Reply Quote 1
                • magicrob
                  magicrob last edited by

                  SEO Spider from Screaming Frog is a great crawler and a notable alternative to Xenu

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post
                  • New SEO manager needs help! Currently only about 15% of our live sitemap (~4 million url e-commerce site) is actually indexed in Google. What are best practices sitemaps for big sites with a lot of changing content?
                    Nigel_Carr
                    Nigel_Carr
                    1
                    4
                    106

                  • Site Architecture & URL length
                    Nigel_Carr
                    Nigel_Carr
                    0
                    4
                    229

                  • If I want clean up my URLs and take the "www.site.com/page.html" and make it "www.site.com/page" do I need a redirect?
                    Booj
                    Booj
                    0
                    4
                    113

                  • We have designed a new site and are in dilemna whether or not to change the site's URL structure or maybe few odd looking urls. How exactly do we go about the URL thing in toto? thanks in advance, any suggestion(s) would be dearly welcome
                    ShaunPhilips
                    ShaunPhilips
                    1
                    7
                    109

                  • Will sitemap generated in Yoast for a combined wordpress/magento site map entire site ?
                    Dan-Lawrence
                    Dan-Lawrence
                    0
                    5
                    1.4k

                  • How to find original URLS after Hosting Company added canonical URLs, URL rewrites and duplicate content.
                    Nobody1560986989723
                    Nobody1560986989723
                    0
                    2
                    366

                  • Crawl reveals hundreds of urls with multiple urls in the url string
                    irvingw
                    irvingw
                    0
                    5
                    455

                  • Will 301 redirecting a site multiple times still preserve the original site value?
                    JoeAmadon
                    JoeAmadon
                    0
                    2
                    588

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy