The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. White Hat / Black Hat SEO
    4. Googlebot crawling AJAX website not always uses _escaped_fragment_

    Googlebot crawling AJAX website not always uses _escaped_fragment_

    White Hat / Black Hat SEO
    1 1 196
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • yohayg
      yohayg last edited by

      Hi,

      I started to investigate googlebot crawl log of our website, and it appears that there is no 1:1 correlation between a crawled URL with escaped_fragment and without it.
      My expectation is that each time that google crawls a URL, a minute or so after, it suppose to crawl the same URL using an escaped_fragment

      For example:
      Googlebot crawl log for https://my_web_site/some_slug

      Results:
      Googlebot crawled this URL 17 times in July:

      http://i.imgur.com/sA141O0.jpg

      Googlebot crawled this URL additional 3 crawls using the escaped_fragment:

      http://i.imgur.com/sOQjyPU.jpg

      Do you have any idea if this behavior is normal?

      Thanks,

      Yohay

      sOQjyPU.jpg sA141O0.jpg

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      • First post
        Last post
      • Our webpage has been embedded in others website using iframe. Does this hurts us in rankings?
        Sally94
        Sally94
        0
        2
        63

      • Does Google and Other Search Engine crawl meta tags if we call it using react .js ?
        MikeTek
        MikeTek
        0
        4
        844

      • Why have bots (including googlebot) categorized my website as adult?
        rahulkan
        rahulkan
        0
        4
        1.2k

      • Do you know any popular websites using fragment identifier or hashbang (#!) in URLs?
        GPainter
        GPainter
        0
        2
        1.6k

      • What are the advantages and disadvantages of having a dynamic website in terms of SEO? and a static website?
        GPainter
        GPainter
        0
        4
        2.6k

      • Lots of websites copied my original content from my own website, what should I do?
        vmialik
        vmialik
        0
        2
        257

      • Googlebot stopped crawling
        Prospector-Plastics
        Prospector-Plastics
        0
        4
        918

      • Advice on using the disavow tool to remove hacked website links
        blagger
        blagger
        0
        3
        1.4k

      Get started with Moz Pro!

      Unlock the power of advanced SEO tools and data-driven insights.

      Start my free trial
      Products
      • Moz Pro
      • Moz Local
      • Moz API
      • Moz Data
      • STAT
      • Product Updates
      Moz Solutions
      • SMB Solutions
      • Agency Solutions
      • Enterprise Solutions
      • Digital Marketers
      Free SEO Tools
      • Domain Authority Checker
      • Link Explorer
      • Keyword Explorer
      • Competitive Research
      • Brand Authority Checker
      • Local Citation Checker
      • MozBar Extension
      • MozCast
      Resources
      • Blog
      • SEO Learning Center
      • Help Hub
      • Beginner's Guide to SEO
      • How-to Guides
      • Moz Academy
      • API Docs
      About Moz
      • About
      • Team
      • Careers
      • Contact
      Why Moz
      • Case Studies
      • Testimonials
      Get Involved
      • Become an Affiliate
      • MozCon
      • Webinars
      • Practical Marketer Series
      • MozPod
      Connect with us

      Contact the Help team

      Join our newsletter
      Moz logo
      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
      • Accessibility
      • Terms of Use
      • Privacy