The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Google Bot Noindex

    Google Bot Noindex

    Technical SEO Issues
    4 2 72
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • MayflyInternet
      MayflyInternet last edited by

      If a site has the tag, can it still be flagged for duplicate content?

      1 Reply Last reply Reply Quote 0
      • Andy.Drinkwater
        Andy.Drinkwater last edited by

        Do you mean from a penalty point of view?

        Google can still crawl and see what is on a page with a noindex flag, but it just won't index it. It doesn't guarantee that duplicate content won't still be an issue for you. This is one of those areas when it comes to Panda that people try. Some just noindex pages and have success with them, others need to remove them altogether.

        -Andy

        MayflyInternet 1 Reply Last reply Reply Quote 1
        • MayflyInternet
          MayflyInternet @Andy.Drinkwater last edited by

          Cheers for the response Andy.

          I do mean from a penalty point of view.

          Can I block Google from crawling the site using the htaccess or robots.txt files?

          I want the page to be indexed in all search engines but Google

          I'm just experimenting and I don't mind whether the site with the duplicated content gets a penalty, but I would very much mind if the site whether the original content came from was given a penalty.

          Will

          Andy.Drinkwater 1 Reply Last reply Reply Quote 0
          • Andy.Drinkwater
            Andy.Drinkwater @MayflyInternet last edited by

            You can prevent Google from crawling the site through the robots.txt rather than the .htaccess Will.

            -Andy

            1 Reply Last reply Reply Quote 1
            • 1 / 1
            • First post
              Last post
            • Can I still monitor noindex, nofollow pages with Google Analytics?
              paints-n-design
              paints-n-design
              0
              2
              471

            • Can you confirm legitimate Google Bot traffic?
              akin67
              akin67
              1
              6
              112

            • How to optimize for different google seach center (google.de, google.ch) ?
              Aleyda
              Aleyda
              0
              4
              270

            • Google bot notification
              juanmiguelcr
              juanmiguelcr
              0
              3
              97

            • Google bot index
              Dr-Pete
              Dr-Pete
              0
              6
              274

            • Does Google Bot accept Cookies
              jeffreytrull1
              jeffreytrull1
              0
              2
              2.7k

            • How a google bot sees your site
              SearchDexSEO
              SearchDexSEO
              0
              7
              4.4k

            • Google SERPs and NoIndex directives.
              gaganc
              gaganc
              0
              4
              486

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy