The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Tool that can retrieve mysite URL's

    Tool that can retrieve mysite URL's

    Intermediate & Advanced SEO
    6 3 117
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • mtthompsons
      mtthompsons last edited by

      Hi,

      Tool that can retrieve mysite URL's

      I am not talking about href,open explorer, Majestic etc

      I have a list of 1000 site URL's where my site name is mentioned. I want to get the exact URL of my site next to the URL i want to query with

      Example

      http://moz.com/community is the URL i have and if this page has mysite name then i need to get the complete URL captured.

      Any software or tool that can do this? I used one for sure which got me this info but now i don't remember it

      Thanks

      1 Reply Last reply Reply Quote 0
      • Vahe.Arabian
        Vahe.Arabian last edited by

        Screaming frog SEO spider tool should be able to help you with this. However to crawl more than its' 500 URL limit, you will need to purchase a licence key.

        http://www.screamingfrog.co.uk/seo-spider/

        Good luck.

        Regards,

        Vahe

        1 Reply Last reply Reply Quote 0
        • Chris.Menke
          Chris.Menke last edited by

          Do a google  search for your "yourdomain.com" and then use a scraper tool to put the results into a google doc.  Here's Seer Interactives tool: http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update

          1 Reply Last reply Reply Quote 0
          • Vahe.Arabian
            Vahe.Arabian last edited by

            That would show what's indexed (which is most) but not all pages 😉

            Chris.Menke 1 Reply Last reply Reply Quote 1
            • Chris.Menke
              Chris.Menke @Vahe.Arabian last edited by

              Yes, I forgot that he already had the list of 1000 sites.  Xenu link sleuth would be another option--it's free.

              1 Reply Last reply Reply Quote 1
              • Vahe.Arabian
                Vahe.Arabian last edited by

                Or a crawl test with moz pro tools

                1 Reply Last reply Reply Quote 0
                • 1 / 1
                • First post
                  Last post
                • I need help on how best to do a complicated site migration. Replacing certain pages with all new content and tools, and keeping the same URL's. The rest just need to disappear safely. Somehow.
                  Everett
                  Everett
                  1
                  4
                  58

                • Can't support IE 7,8,9, 10\. Can we redirect them to another page that's optimized for those browsers so that we can have our site work on modern browers while still providing a destination of IE browsers?
                  0
                  1
                  18

                • Migrating From Parameter-Driven URL's to 'SEO Friendly URL's (Slugs)
                  PatrickDelehanty
                  PatrickDelehanty
                  0
                  2
                  292

                • Will disallowing URL's in the robots.txt file stop those URL's being indexed by Google
                  Martijn_Scheijbeler
                  Martijn_Scheijbeler
                  0
                  11
                  1.6k

                • Partial Match or RegEx in Search Console's URL Parameters Tool?
                  Andy.Drinkwater
                  Andy.Drinkwater
                  0
                  15
                  1.5k

                • Does Google Read URL's if they include a # tag? Re: SEO Value of Clean Url's
                  Atlanta-SMO
                  Atlanta-SMO
                  0
                  6
                  1.6k

                • How can I get a list of every url of a site in Google's index?
                  KaneJamison
                  KaneJamison
                  0
                  8
                  1.1k

                • Best solution to get mass URl's out the SE's index
                  James77
                  James77
                  0
                  3
                  583

                Get started with Moz Pro!

                Unlock the power of advanced SEO tools and data-driven insights.

                Start my free trial
                Products
                • Moz Pro
                • Moz Local
                • Moz API
                • Moz Data
                • STAT
                • Product Updates
                Moz Solutions
                • SMB Solutions
                • Agency Solutions
                • Enterprise Solutions
                • Digital Marketers
                Free SEO Tools
                • Domain Authority Checker
                • Link Explorer
                • Keyword Explorer
                • Competitive Research
                • Brand Authority Checker
                • Local Citation Checker
                • MozBar Extension
                • MozCast
                Resources
                • Blog
                • SEO Learning Center
                • Help Hub
                • Beginner's Guide to SEO
                • How-to Guides
                • Moz Academy
                • API Docs
                About Moz
                • About
                • Team
                • Careers
                • Contact
                Why Moz
                • Case Studies
                • Testimonials
                Get Involved
                • Become an Affiliate
                • MozCon
                • Webinars
                • Practical Marketer Series
                • MozPod
                Connect with us

                Contact the Help team

                Join our newsletter
                Moz logo
                © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                • Accessibility
                • Terms of Use
                • Privacy