The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. I am looking for best way to block a domain from getting indexed ?

    I am looking for best way to block a domain from getting indexed ?

    Technical SEO Issues
    5 2 90
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Prasadgotteti
      Prasadgotteti last edited by

      We have a website http://www.example.co.uk/ which leads to another domain (https://online.example.co.uk/) when a user clicks,in this case let us assume it to be Apply now button on my website page. We are getting meta data issues in crawler errors from this (https://online.example.co.uk/) domain as we are not targeting any meta content on this particular domain.  So we are looking to block this domain from getting indexed to clear this errors & does this effect SERP's of this domain (**https://online.example.co.uk/) **if we use no index tag on this domain.

      1 Reply Last reply Reply Quote 0
      • Click_Here_Digital
        Click_Here_Digital last edited by

        If you use the meta noindex on page then it will be blocked from the index. So, yes, it will effect the SERPs of that domain by removing any results from the SERPs.

        Prasadgotteti 1 Reply Last reply Reply Quote 0
        • Prasadgotteti
          Prasadgotteti @Click_Here_Digital last edited by

          Hi thanks for letting me know this , it will be great if you have any wildcard to solve this

          1 Reply Last reply Reply Quote 0
          • Click_Here_Digital
            Click_Here_Digital last edited by

            I'd recommend putting a robots.txt file on the https://online.example.co.uk site you don't want indexed.

            Just save the following as robots.txt:

            User-agent: *
            Disallow: /

            then add it to the the root folder of the site like https://online.example.co.uk/robots.txt

            This tells all the search spiders not to index or crawl any pages on the entire site.

            Prasadgotteti 1 Reply Last reply Reply Quote 0
            • Prasadgotteti
              Prasadgotteti @Click_Here_Digital last edited by

              Hi the real challenge here is we are not using any Google entities like webmaster tools etc on https://online.example.co.uk so to my knowledge robots.txt wont work, will be waiting to hear from you if we have any other options here.

              Thanks

              P

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Some of my website urls are not getting indexed while checking (site: domain) in google
                MattRoney
                MattRoney
                0
                3
                95

              • Is there a way to get Google to index more of your pages for SEO ranking?
                CarlosZambrana
                CarlosZambrana
                0
                5
                2.1k

              • My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Please advise.
                Vuly
                Vuly
                0
                5
                1.6k

              • Best way to handle indexed pages you don't want indexed
                NakulGoyal
                NakulGoyal
                0
                11
                786

              • Best way to get SEO friendly URLSs on huge old website
                SCL-SEO
                SCL-SEO
                1
                3
                399

              • Whats the best way to stop search results from being indexed?
                Sebes
                Sebes
                0
                4
                1.0k

              • What is the best method to block a sub-domain, e.g. staging.domain.com/ from getting indexed?
                KeriMorgret
                KeriMorgret
                0
                13
                6.3k

              • What's the best way to transplant a blogger blog to another domain?
                mattotoole
                mattotoole
                0
                6
                1.0k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy