The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Local Strategy
    4. Is there a way to get a list of urls on the website?

    Is there a way to get a list of urls on the website?

    Local Strategy
    4 4 1.3k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • SeobyKP
      SeobyKP last edited by

      For example, www.laskeimages.com

      Outside of Google Search Console, is there another way?

      1 Reply Last reply Reply Quote 0
      • seoelevated
        seoelevated last edited by

        If all of the pages you are interested in are linked internally from somewhere in your site which can be reached through navigation or page links, you can run a simulated crawl with a tool like ScreamingFrog, whcih will discover all the "discoverable" pages.

        The site you referenced is built with a platform called "Good Gallery", whcih generates a sitemap. This is at  www.laskeimages.com/sitemap.xml. I'm not sure what criteria it might use to include/exclude pages, but that would likely be a good list. You will need to view the page source of that page to see the data in a structured way to extract it.

        Another method is to use Google Analytics. Assuming that each page of your site has been viewed at least once in its history, you could extract the list from Google Analytics. Especially from an unfiltered view which includes visits by bots.

        1 Reply Last reply Reply Quote 2
        • Cobblerocks
          Cobblerocks last edited by

          slickplan.com allows you to pull the entire sitemap of your site and pull links, descriptions etc

          1 Reply Last reply Reply Quote 0
          • WebQuest
            WebQuest last edited by

            You can run a "site:yourwebsite.com" search on google and see what is returned.  Based on the results you can run further "site:" searches along with more parameters to see more URLs in the index.

            A general "site:yourwebsite.com" idea about how many pages are in the index, but it's not 100% accurate.

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • HOW DOES MOZ FILTER ISSUES ON WEBSITES?
              Kenn_Gold
              Kenn_Gold
              0
              2
              70

            • How to get listed for specific locations/cities/towns
              MiriamEllis
              MiriamEllis
              1
              4
              104

            • What's the best way to create keyword tracking lists for local SEO?
              2
              1
              49

            • One website or multiple websites
              MiriamEllis
              MiriamEllis
              1
              10
              1.6k

            • How should i Get Max Traffic To my website
              MiriamEllis
              MiriamEllis
              0
              4
              204

            • Local SEO Website Structure.
              MiriamEllis
              MiriamEllis
              0
              4
              842

            • Dynamic websites & SEO
              LauraSultan
              LauraSultan
              0
              4
              188

            • How to remove countries viewing my website
              Mark_Ch
              Mark_Ch
              0
              6
              1.4k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy