The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. International Issues
    4. How well does Google's "Locale-aware crawling by Googlebot" work?

    How well does Google's "Locale-aware crawling by Googlebot" work?

    International Issues
    3 2 558
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Veva
      Veva last edited by

      Hello,

      In January of this year Google introduced "Locale-aware crawling by Googlebot."

      https://support.google.com/webmasters/answer/6144055?hl=e

      Google uses different crawl settings for sites that cannot have separate URLs for each locale. .........   This is basically for sites that dynamically render contend on the same URL depending on the locale and language (IP) of the visitor. If e.g. a visitor was coming from France, the targeted page would load in french. If a visitor was coming from the US the same page would load in English on the same URL.

      Does anyone have any experience with this setup and how well it works?

      How well do the different versions of a page get indexed, and how well do those pages rank?

      In the example above, does the french content get indexed correctly?

      Many thanks!

      1 Reply Last reply Reply Quote 0
      • DirkC
        DirkC last edited by

        No personal experience with it - but seen already some cases on the Q&A where it generated problems. In one specific case all traffic outside Ireland was shown a default language page - inside Ireland the full content was available. None of the content was indexed by Google until the ip blocking was removed.

        The note on the page you mention already gives a hint:

        IMPORTANT: We continue to support and recommend using separate locale URL configurations and annotating them with rel=alternate hreflang annotations.

        If your website has pages that return different content based on the perceived country or preferred language of the visitor (i.e., you have locale-adaptive pages), Google might not crawl, index, or rank all of your locale-adaptive content.

        You can try it but you run a huge risk that your content will not be indexed or only partially indexed. Better to use the hreflang solution - as propose by Google.

        Dirk

        Veva 1 Reply Last reply Reply Quote 0
        • Veva
          Veva @DirkC last edited by

          Many thanks! I was looking for examples of issues with this setup.

          Some stakeholders find the dynamic solution appealing (as it is much easier to set up for us), thereby forgoing the opportunity to set up the site correctly for international indexing and ranking. I would like to be able to illustrate the potential shortcomings.

          Many thanks again!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Geolocation issue: Google not displaying the correct url in the SERP's
            ederdesign
            ederdesign
            0
            2
            100

          • What's the difference between 'en-gb' and 'en-uk; when choosing Search engines in campaign set up?
            to909
            to909
            0
            11
            33.0k

          • Recent Google Link Scheme Updated ? What's Your Reaction against Link Building, Link Exchanging ?
            Everett
            Everett
            0
            5
            267

          • Dynamic Google search snippet text based on user's language
            MatthewBarby
            MatthewBarby
            0
            2
            205

          • Hotel Multi country targeting + Google Local + TLDs => "MesSEO"
            retsimister
            retsimister
            0
            6
            628

          • How well does Google's crawlers understand foreign websites?
            gfiorelli1
            gfiorelli1
            0
            3
            663

          • Geo-targeting a sub-folder that's had url's rewritten from a sub-domain
            Leighm
            Leighm
            0
            5
            888

          • Geo Targeting for Similar Sites to Specific Countries in Google's Index
            j0a0vargas
            j0a0vargas
            0
            2
            1.2k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy