The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. How do you de-index and prevent indexation of a whole domain?

    How do you de-index and prevent indexation of a whole domain?

    Intermediate & Advanced SEO
    3 3 430
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Martin_S
      Martin_S last edited by

      I have parts of an online portal displaying in SERPs which it definitely shouldn't be. It's due to thoughtless developers but I need to have the whole portal's domain de-indexed and prevented from future indexing.

      I'm not too tech savvy but how is this achieved? No index? Robots?

      thanks

      1 Reply Last reply Reply Quote 0
      • Martijn_Scheijbeler
        Martijn_Scheijbeler last edited by

        Hi TCE,

        There are two options in my opinion for this which are the best (as their are several other options including META robots etc):

        1. Robots.txt: Exclude your portal via your robots.txt file.
        2. HTTP Auth: Let your developers add HTTP Authentication so you have to log in to see the portal. Google won't be able to see the pages itself and so will de index them.

        Hope this helps.

        1 Reply Last reply Reply Quote 1
        • SebastianCowie
          SebastianCowie last edited by

          Fastest way to do it would be through a combination of Google Webmaster Tools and Robots.txt / noindex,nofollow meta tags.

          Firstly if your domain hasn't been verified within GWT, go through that process. Then proceed with the remove URL request within GWT. (Image Attached)

          You will need to upload a robots.txt and/or implement the noindex meta tag within the header of the pages you no longer want indexed.

          Example Robots.txt:

          User-agent: *
          Disallow: /offendingportal/

          Example Robots Meta tag:

          That should be enough to get rid of the offending content from within the SERPS and prevent it from being re-indexed.

          removeurl.png

          1 Reply Last reply Reply Quote 1
          • 1 / 1
          • First post
            Last post
          • Domains and Domain Authority
            brettmandoes
            brettmandoes
            0
            4
            42

          • Why is wrong domain being indexed?
            MattRoney
            MattRoney
            0
            4
            223

          • Index or not index Categories
            PinpointDesigns
            PinpointDesigns
            0
            6
            131

          • To index or de-index internal search results pages?
            LesleyPaone
            LesleyPaone
            0
            5
            2.3k

          • Duplicate Sub-domains Being Indexed
            EdwardDennis
            EdwardDennis
            0
            5
            111

          • How Long Does it Take for Rel Canonical to De-Index / Re-Index a Page?
            Travis-W
            Travis-W
            0
            3
            906

          • Another duplicate page title www.domain.com vs www.domain.com/index.html question
            Matt-Williamson
            Matt-Williamson
            0
            2
            405

          • De-indexed Link Directory
            ChrisDyson
            ChrisDyson
            0
            4
            307

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy