The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Is it OK to have Search Engines Skip Ajax Content Execution?

    Is it OK to have Search Engines Skip Ajax Content Execution?

    Intermediate & Advanced SEO
    1 1 102
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • friendoffood
      friendoffood last edited by

      I recently added some ajax pages to automatically fill in small areas of my site upon page loading.  That is, the user doesn't have to click anything.  Therefore when Google and Bing crawl the site the ajax is executed too.  However, my understanding is that does not mean Google and Bing are also crawling the ajax content.

      I actually would prefer that the content  would be not be executed OR crawled by them.  In the case of Bing I would prefer that the content not even be executed because indications are that the program exits the ajax page for Bing because Bing isn't retaining session variables which that page uses, which makes me concerned that perhaps when that happens Bing isn't able to even crawl the main content..dunno..So, ajax execution seems potentially risky for normal crawling in this case.

      I would like to simply have my program skip the ajax execution for Google and Bing by recognizing them in the useragent and using an If robot == Y skip ajax approach.  I assume I could put the ajax program in the robots.txt file but that wouldn't keep Bing from executing it (and having that exit problem mentioned above).  It would be simpler to just have them skip the ajax execution altogether.

      Is that ok or is there a chance the search engines will penalize my site if they find out (somehow) that I have different logic for them than for the actual users?  In the past this surely was not a concern but I understand that Google is increasingly trying to become like a browser so may increasingly have a problem with this approach.

      Thoughts?

      1 Reply Last reply Reply Quote 0
      • 1 / 1
      • First post
        Last post
      • Which search engines should we submit our sitemap to?
        BlueCorona
        BlueCorona
        0
        7
        1.7k

      • Do search engine consider this duplicate or thin content?
        elsenorglobo
        elsenorglobo
        0
        2
        130

      • Search engine submission - Urgent
        solvid
        solvid
        0
        10
        396

      • List of Search Engines subscribing to the ajax crawling scheme?
        Aleyda
        Aleyda
        0
        3
        382

      • Is this ok for content on our site?
        EGOL
        EGOL
        0
        5
        139

      • Ajax Content Indexed
        Cyrus-Shepard
        Cyrus-Shepard
        1
        2
        323

      • Soft Hyphenation: Influence on Search Engines
        zeepartner
        zeepartner
        0
        3
        1.6k

      • Search Engine Pingler
        KeriMorgret
        KeriMorgret
        0
        4
        1.6k

      Get started with Moz Pro!

      Unlock the power of advanced SEO tools and data-driven insights.

      Start my free trial
      Products
      • Moz Pro
      • Moz Local
      • Moz API
      • Moz Data
      • STAT
      • Product Updates
      Moz Solutions
      • SMB Solutions
      • Agency Solutions
      • Enterprise Solutions
      • Digital Marketers
      Free SEO Tools
      • Domain Authority Checker
      • Link Explorer
      • Keyword Explorer
      • Competitive Research
      • Brand Authority Checker
      • Local Citation Checker
      • MozBar Extension
      • MozCast
      Resources
      • Blog
      • SEO Learning Center
      • Help Hub
      • Beginner's Guide to SEO
      • How-to Guides
      • Moz Academy
      • API Docs
      About Moz
      • About
      • Team
      • Careers
      • Contact
      Why Moz
      • Case Studies
      • Testimonials
      Get Involved
      • Become an Affiliate
      • MozCon
      • Webinars
      • Practical Marketer Series
      • MozPod
      Connect with us

      Contact the Help team

      Join our newsletter
      Moz logo
      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
      • Accessibility
      • Terms of Use
      • Privacy