The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Googlebot on paywall made with cookies and local storage

    Googlebot on paywall made with cookies and local storage

    Intermediate & Advanced SEO
    3 2 1.2k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • OPU
      OPU last edited by

      My question is about paywalls made with cookies and local storage. We are changing a website with free content to a open paywall with a 5 article view weekly limit.

      The paywall is made to work with cookies and local storage. The article views are stored to local storage but you have to have your cookies enabled so that you can read the free articles. If you don't have cookies enable we would pass an error page (otherwise the paywall would be easy to bypass).

      Can you say how this affects SEO? We would still like that Google would index all article pages that it does now.

      Would it be cloaking if we treated Googlebot differently so that when it does not have cookies enabled, it would still be able to index the page?

      1 Reply Last reply Reply Quote 1
      • CatalystSEM
        CatalystSEM last edited by

        To make sure that I'm getting your question correct. You want Google to crawl and index all your content but you want visitors to use an open paywall that shows 5 free articles then resorts to a paywall.

        Yes, it would be treated as cloaking but you have a legitimate reason for doing so and intent matters a great deal. You could check for a search engine user-agent string such as  "Googlebot" and then serve the full content. This would ensure that your content is still crawled and indexed.

        The only downside is any tech savvy individual can spoof the server header by setting their user-agent to "Googlebot" and bypass your paywall.

        OPU 1 Reply Last reply Reply Quote 0
        • OPU
          OPU @CatalystSEM last edited by

          Thank you for your answer!

          Yes, that is exactly the case.

          We have been testing this and it seems that "Googlebot" doesn't hit the wall at all with the normal settings on. With these results it seems that we don't need to treat "Googlebot" differently because it doesn't seem to store any cookie or local storage data.

          Tech savvy users can bypass the pay wall by other means as well so that's not a big concern for us.

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Local Sitelinks
            RuthBurrReedy
            RuthBurrReedy
            0
            3
            134

          • Googlebot on steroids... Why?
            Olaf
            Olaf
            0
            7
            82

          • Massive local + national disconnect in rankings (local deindexed)
            RuthBurrReedy
            RuthBurrReedy
            0
            2
            67

          • Mobile Googlebot vs Desktop Googlebot - GWT reports - Crawl errors
            iPullRank
            iPullRank
            0
            3
            832

          • Local SEO - Do I need it if I don't do business locally?
            PatrickDelehanty
            PatrickDelehanty
            1
            8
            217

          • Mission Possible? You have 3 hours to do Local SEO. Which top 5 sites do you go Social Bookmark, Local Search Engine Submit and Directory List.
            sovidiu
            sovidiu
            0
            6
            573

          • Fetch as Googlebot
            KeriMorgret
            KeriMorgret
            0
            6
            1.2k

          • Local Searches done from outside of local area better than searches from within local area
            Nick_Ker
            Nick_Ker
            0
            5
            724

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy