The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. Is there a tool that I can use to scrape and see metatags?

    Is there a tool that I can use to scrape and see metatags?

    On-Page / Site Optimization
    8 6 2.1k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Gavo
      Gavo last edited by

      Looking for a tool that allows me to scrape the websites off a page listing of Google and output a spreadsheet with the websites and their related meta-tag details (mainly title tag). Is there a tool out there that can conveniently allow me to do this?

      1 Reply Last reply Reply Quote 0
      • AvvioDigital
        AvvioDigital last edited by

        Screaming Frog is a great tool for this.

        DonnaDuncan 1 Reply Last reply Reply Quote 0
        • DonnaDuncan
          DonnaDuncan @AvvioDigital last edited by

          I don't think you can use Screaming Frog for that. It will certainly give you a ton of information about a single website, but it doesn't allow you to scrape Google search results and derive meta data for the top X results. Unless I'm missing something....

          Bryan_Loconto 1 Reply Last reply Reply Quote 1
          • Bryan_Loconto
            Bryan_Loconto @DonnaDuncan last edited by

            Agreed Donna! It would be nice if Screaming Frog did that but it doesn't. I'm not sure of any existing tools that would do that.

            You can run each site from the SERP through Screaming Frog to get all that data exported but that would take a good amount of time!

            1 Reply Last reply Reply Quote 1
            • KeriMorgret
              KeriMorgret last edited by

              Also keep in mind that search engines will change the title displayed in the SERP based on your query, so if you just get the info presented in the SERP, you may not be seeing the actual title tag.

              1 Reply Last reply Reply Quote 0
              • MattAntonino
                MattAntonino last edited by

                You can do this fairly easily with ImportXML in Google docs or xpath in Excel.

                This is the guide that got me started:

                https://www.distilled.net/blog/distilled/guide-to-google-docs-importxml/

                If you use Chrome, finding the xpath is fairly simple and then you can just add it to your list.

                The other way to do this is use Seer's Top 30 Results Scraper alongside the SEO Tools Excel plugin:

                http://www.seerinteractive.com/blog/google-scraper-in-google-docs-update

                In Excel tools simply use =htmltitle() and get the info you need.

                DonnaDuncan 1 Reply Last reply Reply Quote 2
                • DonnaDuncan
                  DonnaDuncan @MattAntonino last edited by

                  Thanks for sharing Matt-Antonino.

                  That's good to know!

                  1 Reply Last reply Reply Quote 0
                  • Gavo
                    Gavo last edited by

                    Thanks for everyone's responses! Matt-Antonino, I'll look to implement that solution. Appreciate it!

                    1 Reply Last reply Reply Quote 0
                    • 1 / 1
                    • First post
                      Last post
                    • Can I use £ character in title tag?
                      vidi0394
                      vidi0394
                      0
                      6
                      30

                    • Where can we see voice search impressions/searches?
                      KevnJr
                      KevnJr
                      0
                      3
                      390

                    • Can i use hard innerlinks on my blog to my landingspages ?
                      MattRoney
                      MattRoney
                      0
                      3
                      108

                    • Can't see the woods for the trees
                      EGOL
                      EGOL
                      0
                      4
                      113

                    • Does anyone use Genesis Framework? If so can a newbie use it and a few other questions
                      DennisSeymour
                      DennisSeymour
                      0
                      2
                      127

                    • Can i use H2 tag for a brand logo
                      parfumerienl
                      parfumerienl
                      0
                      3
                      225

                    • Can I use Same Keyword for Multi pages Title Tags?
                      Scurri
                      Scurri
                      0
                      5
                      2.7k

                    • Do you think using accordion text can hurt SEO?
                      Sandicliffe
                      Sandicliffe
                      1
                      8
                      5.4k

                    Get started with Moz Pro!

                    Unlock the power of advanced SEO tools and data-driven insights.

                    Start my free trial
                    Products
                    • Moz Pro
                    • Moz Local
                    • Moz API
                    • Moz Data
                    • STAT
                    • Product Updates
                    Moz Solutions
                    • SMB Solutions
                    • Agency Solutions
                    • Enterprise Solutions
                    • Digital Marketers
                    Free SEO Tools
                    • Domain Authority Checker
                    • Link Explorer
                    • Keyword Explorer
                    • Competitive Research
                    • Brand Authority Checker
                    • Local Citation Checker
                    • MozBar Extension
                    • MozCast
                    Resources
                    • Blog
                    • SEO Learning Center
                    • Help Hub
                    • Beginner's Guide to SEO
                    • How-to Guides
                    • Moz Academy
                    • API Docs
                    About Moz
                    • About
                    • Team
                    • Careers
                    • Contact
                    Why Moz
                    • Case Studies
                    • Testimonials
                    Get Involved
                    • Become an Affiliate
                    • MozCon
                    • Webinars
                    • Practical Marketer Series
                    • MozPod
                    Connect with us

                    Contact the Help team

                    Join our newsletter
                    Moz logo
                    © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                    • Accessibility
                    • Terms of Use
                    • Privacy