The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Software/tool for Content Inventory

    Software/tool for Content Inventory

    On-Page / Site Optimization
    4 4 1.9k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • StickyRiceSEO
      StickyRiceSEO last edited by

      Is there any tool out there which can crawl a section of a website (or whole website) and gives a list of urls by subsections?

      I have tried PowerMapper but it only gives visual map, not a list.

      Thanks!

      1 Reply Last reply Reply Quote 0
      • AbilityGroup
        AbilityGroup last edited by

        How about Screaming Frog? - http://www.screamingfrog.co.uk/seo-spider/

        1 Reply Last reply Reply Quote 0
        • KevinBudzynski
          KevinBudzynski last edited by

          Xenu mya work http://home.snafu.de/tilman/xenulink.html

          1 Reply Last reply Reply Quote 0
          • hardy231088
            hardy231088 last edited by

            You can use Moz, Screaming Frog, Sort Site to get results.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Hi - How do you get rid of duplicate content that was accidentally created on a tag url? For example, when I published a new article, the content was duplicated on: /posts/tag/lead-generation/
              MikeRoberts
              MikeRoberts
              0
              4
              82

            • SERP Hijacking/Content Theft/ 302 Redirect?
              SneakerFiles
              SneakerFiles
              0
              4
              577

            • Htaccess redirect, from /year/month to /blog
              sergeystefoglo
              sergeystefoglo
              0
              3
              338

            • https://www.freedomltd.com/stag-weekend/
              henandstag
              henandstag
              0
              3
              109

            • Any idea how Google is doing this? Is it schematic? http://techcrunch.com/2014/02/28/google-adds-full-restaurant-menus-to-its-search-results-pages/
              Ron_McCabe
              Ron_McCabe
              0
              4
              118

            • Internal Duplicate Content/Canonical Issue/ or nothing to worry about
              SorinaDascalu
              SorinaDascalu
              0
              4
              161

            • Redirecting web site URL to http://torontoairportlimoflatrate.com/ to http://www.torontoairportlimoflatrate.com
              My-Favourite-Holiday-Cottages
              My-Favourite-Holiday-Cottages
              0
              2
              419

            • Http://www.xxxx.com does not re-direct to http://xxx.com
              DeptAgency
              DeptAgency
              0
              10
              46.5k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy