The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Google crawling different content--ever ok?

    Google crawling different content--ever ok?

    Intermediate & Advanced SEO
    5 3 133
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • friendoffood
      friendoffood last edited by

      Here are a couple of scenarios I'm encountering where Google will crawl different content than my users on initial visit to the site--and which I think should be ok.  Of course, it is normally NOT ok,  I'm here to find out if Google is flexible enough to allow these situations:

      1. My mobile friendly site has users select a city, and then it displays the location options div which includes an explanation for why they may want to have the program use their gps location.  The user must choose the gps, the entire city, or he can enter a zip code, or choose a suburb of the city, which then goes to the link chosen.  OTOH it is programmed so that if it is a Google bot it doesn't get just a meaningless 'choose further' page, but rather the crawler sees the page of results for the entire city (as you would expect from the url),   So basically the program defaults for the entire city results for google bot, but for for the user it first gives him the initial ability to choose gps.

      2. A user comes to mysite.com/gps-loc/city/results   The site, seeing the literal words 'gps-loc' in the url goes out and fetches the gps for his location and returns results dependent on his location.   If Googlebot comes to that url then there is no way the program will return the same results because the program wouldn't be able to get the same long latitude as that user.

      So, what do you think?  Are these scenarios a concern for getting penalized by Google?

      Thanks, Ted

      1 Reply Last reply Reply Quote 0
      • Sheena_Schleicher
        Sheena_Schleicher last edited by

        I do not have experience with any site using this type of selector, but theoretically you should not encounter any problems as you're showing different content with the intent of improving the experience, not to deceive. If Google handles this like an ip-redirect, then you should be fine.

        In scenario 2, however, I'm wondering if you even want Google to index these URLs - since it sounds like these URLs will be dynamically generated & might end up being duplicates of other pages on the site (similar to internal search pages). Something to watch out for!

        friendoffood 1 Reply Last reply Reply Quote 2
        • Cyrus-Shepard
          Cyrus-Shepard last edited by

          This is not the definition of cloaking and I wouldn't worry too much about any penalty.

          That said, anytime you redirect googlebot to a different experience than users it's a situation you want to be very careful with, and in most situations avoid. Often this is solved by serving different experiences via javascript. Even though Google is pretty darn good at parsing javascript, they will often interpret the default version of a page as if the javascript is turned off.

          Regardless, I'd keep an eye on search results, Google Webmaster Tools, cached versions of your site and make ample use of "Fetch and Render" in GWT to ensure Google interprets your site they way you think it should.

          friendoffood 1 Reply Last reply Reply Quote 2
          • friendoffood
            friendoffood @Sheena_Schleicher last edited by

            Thanks Sheena.  In the second scenario good point--they are generated via user POST so in theory Google should never see them or index them, but since they can be shared Google ends up finding them, so I do need to make sure Google doesn't index them if possible.

            1 Reply Last reply Reply Quote 0
            • friendoffood
              friendoffood @Cyrus-Shepard last edited by

              Thanks Cyrus.  Very good points!

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Does Google frown on using 3 different page titles with same content to secure the top 3 results in SERPs?
                LureCreative
                LureCreative
                1
                4
                40

              • Do I need to add the actual language for meta tags and description for different languages? cited for duplicate content for different language
                Matthew_Edgar
                Matthew_Edgar
                0
                2
                785

              • Does content revealed by a 'show more' button get crawled by Google?
                becole
                becole
                0
                4
                838

              • Should we show(to google) different city pages on our website which look like home page as one page or different? If yes then how?
                sanchitmalik
                sanchitmalik
                0
                3
                140

              • Same content pages in different versions of Google - is it duplicate>
                pauledwards
                pauledwards
                0
                4
                243

              • Need help with duplicate content. Same content; different locations.
                sergio_redondo
                sergio_redondo
                0
                2
                339

              • Mobile Site - Same Content, Same subdomain, Different URL - Duplicate Content?
                Carson-Ward
                Carson-Ward
                0
                6
                1.5k

              • Is there any delay between crawling a page by google and displaying of the ratings in rich snippet of the results in google?
                NEWCRAFT
                NEWCRAFT
                0
                3
                545

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy