The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. I am looking for best way to block a domain from getting indexed ?

    I am looking for best way to block a domain from getting indexed ?

    Technical SEO Issues
    5 2 90
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Prasadgotteti
      Prasadgotteti last edited by

      We have a website http://www.example.co.uk/ which leads to another domain (https://online.example.co.uk/) when a user clicks,in this case let us assume it to be Apply now button on my website page. We are getting meta data issues in crawler errors from this (https://online.example.co.uk/) domain as we are not targeting any meta content on this particular domain.  So we are looking to block this domain from getting indexed to clear this errors & does this effect SERP's of this domain (**https://online.example.co.uk/) **if we use no index tag on this domain.

      1 Reply Last reply Reply Quote 0
      • Click_Here_Digital
        Click_Here_Digital last edited by

        If you use the meta noindex on page then it will be blocked from the index. So, yes, it will effect the SERPs of that domain by removing any results from the SERPs.

        Prasadgotteti 1 Reply Last reply Reply Quote 0
        • Prasadgotteti
          Prasadgotteti @Click_Here_Digital last edited by

          Hi thanks for letting me know this , it will be great if you have any wildcard to solve this

          1 Reply Last reply Reply Quote 0
          • Click_Here_Digital
            Click_Here_Digital last edited by

            I'd recommend putting a robots.txt file on the https://online.example.co.uk site you don't want indexed.

            Just save the following as robots.txt:

            User-agent: *
            Disallow: /

            then add it to the the root folder of the site like https://online.example.co.uk/robots.txt

            This tells all the search spiders not to index or crawl any pages on the entire site.

            Prasadgotteti 1 Reply Last reply Reply Quote 0
            • Prasadgotteti
              Prasadgotteti @Click_Here_Digital last edited by

              Hi the real challenge here is we are not using any Google entities like webmaster tools etc on https://online.example.co.uk so to my knowledge robots.txt wont work, will be waiting to hear from you if we have any other options here.

              Thanks

              P

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Is there a way to get a list of all pages of your website that are indexed in Google?
                effectdigital
                effectdigital
                0
                3
                177

              • Some of my website urls are not getting indexed while checking (site: domain) in google
                MattRoney
                MattRoney
                0
                3
                95

              • Is there a way to get Google to index more of your pages for SEO ranking?
                CarlosZambrana
                CarlosZambrana
                0
                5
                2.1k

              • Whats the best way to stop search results from being indexed?
                Sebes
                Sebes
                0
                4
                1.0k

              • Block a sub-domain from being indexed
                X-X
                X-X
                0
                7
                13.1k

              • Snagged an Expired Domain Best way to get all the Link Juce?
                MarieHaynes
                MarieHaynes
                0
                3
                1.0k

              • What's the best way to transplant a blogger blog to another domain?
                mattotoole
                mattotoole
                0
                6
                1.0k

              • What is consider best practice today for blocking admins from potentially getting indexed
                perfectweb
                perfectweb
                0
                5
                907

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy