The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. I am looking for best way to block a domain from getting indexed ?

    I am looking for best way to block a domain from getting indexed ?

    Technical SEO Issues
    5 2 90
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Prasadgotteti
      Prasadgotteti last edited by

      We have a website http://www.example.co.uk/ which leads to another domain (https://online.example.co.uk/) when a user clicks,in this case let us assume it to be Apply now button on my website page. We are getting meta data issues in crawler errors from this (https://online.example.co.uk/) domain as we are not targeting any meta content on this particular domain.  So we are looking to block this domain from getting indexed to clear this errors & does this effect SERP's of this domain (**https://online.example.co.uk/) **if we use no index tag on this domain.

      1 Reply Last reply Reply Quote 0
      • Click_Here_Digital
        Click_Here_Digital last edited by

        If you use the meta noindex on page then it will be blocked from the index. So, yes, it will effect the SERPs of that domain by removing any results from the SERPs.

        Prasadgotteti 1 Reply Last reply Reply Quote 0
        • Prasadgotteti
          Prasadgotteti @Click_Here_Digital last edited by

          Hi thanks for letting me know this , it will be great if you have any wildcard to solve this

          1 Reply Last reply Reply Quote 0
          • Click_Here_Digital
            Click_Here_Digital last edited by

            I'd recommend putting a robots.txt file on the https://online.example.co.uk site you don't want indexed.

            Just save the following as robots.txt:

            User-agent: *
            Disallow: /

            then add it to the the root folder of the site like https://online.example.co.uk/robots.txt

            This tells all the search spiders not to index or crawl any pages on the entire site.

            Prasadgotteti 1 Reply Last reply Reply Quote 0
            • Prasadgotteti
              Prasadgotteti @Click_Here_Digital last edited by

              Hi the real challenge here is we are not using any Google entities like webmaster tools etc on https://online.example.co.uk so to my knowledge robots.txt wont work, will be waiting to hear from you if we have any other options here.

              Thanks

              P

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Is there a way to get a list of all pages of your website that are indexed in Google?
                effectdigital
                effectdigital
                0
                3
                177

              • Some of my website urls are not getting indexed while checking (site: domain) in google
                MattRoney
                MattRoney
                0
                3
                95

              • Is there a way to index important pages manually or to make sure a certain page will get indexed in a short period of time??
                rijwielcashencarry040
                rijwielcashencarry040
                0
                7
                111

              • Correct linking to the /index of a site and subfolders: what's the best practice? link to: domain.com/ or domain.com/index.html ?
                CleverPhD
                CleverPhD
                0
                4
                245

              • My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Please advise.
                Vuly
                Vuly
                0
                5
                1.6k

              • Whats the best way to stop search results from being indexed?
                Sebes
                Sebes
                0
                4
                1.0k

              • What is the best method to block a sub-domain, e.g. staging.domain.com/ from getting indexed?
                KeriMorgret
                KeriMorgret
                0
                13
                6.3k

              • Block a sub-domain from being indexed
                X-X
                X-X
                0
                7
                13.1k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy