The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Un-Indexing a Page without robots.txt or access to HEAD

    Un-Indexing a Page without robots.txt or access to HEAD

    Technical SEO Issues
    5 3 412
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DRSearchEngOpt
      DRSearchEngOpt last edited by

      I am in a situation where a page was pushed live  (Went live for an hour and then taken down) before it was supposed to go live. Now normally I would utilize the robots.txt or  but I do not have access to either and putting a request in will not suffice as it is against protocol with the CMS.  So basically I am left to just utilizing the and I cannot seem to find a nice way to play with the SE to get this un-indexed.  I know for this instance I could go to GWT and do it but for clients that do not have GWT and for all the other SE's how could I do this?

      Here is the big question here: What if I have a promotional page that I don't want indexed and am met with these same limitations?  Is there anything to do here?

      1 Reply Last reply Reply Quote 0
      • Desiree-CP
        Desiree-CP last edited by

        I know this may sound obvious but I thought I would ask anyways: are you sure your page was indexed?

        To check if this is the case go to Google or Bingahoo and type in **site:websiteURL.  **If your page in question does NOT show up then you don't have a problem.

        However, if it does then I would urge you to quickly register your client's website with GWT and request a URL removal.  Also, if you want the page to get de-indexed "faster" I would recommend taking down the page altogether and implementing a 301 Permanent Redirect to a relevant page.  If you don't have a relevant page then server up a header response of 404 Not Found.

        Of course, if that is too technical and you don't have development resources then you can just delete all the content on the page (or insert a "coming soon" image) and no one would be the wiser.  =]

        I hope that helps!

        evolvingSEO DRSearchEngOpt 2 Replies Last reply Reply Quote 1
        • evolvingSEO
          evolvingSEO @Desiree-CP last edited by

          Great answer - "bingahoo" - love that.

          1 Reply Last reply Reply Quote 0
          • DRSearchEngOpt
            DRSearchEngOpt @Desiree-CP last edited by

            Yeah the page was definitely indexed and that is how I found it.  The issue is pretty much over at this point as this was supposed to be a surprise announcement later this week but people found it up, posted it to forums and well...so much for that.  It was a client side error so I am not worried.

            Now what I want to figure out is how to make sure that, if I am running a promotional page for specific traffic during a promo period and do not want the page indexed and am limited to only alter within the , it doesn't get indexed...Is this possible?

            Desiree-CP 1 Reply Last reply Reply Quote 0
            • Desiree-CP
              Desiree-CP @DRSearchEngOpt last edited by

              No, unfortunately there is no way to prevent search engine indexation within the tags of your web page.  As you mentioned earlier in your question, you can either utilize the meta robots exclusion tag or the robots.txt file.

              If you are REALLY intent on blocking indexation of your promotional page and can only use the section, perhaps you can consider using an <iframe>?  For example, create a totally new page with your promotional copy and blocked by robots.txt while ensuring you have NO links pointing to it.  Then on your promotional page use the <iFrame> tag to extract the content from the robots.txt blocked copy.</p> <p>Honestly, I'm not sure if it'll prevent indexation since I've never tried it before but just an idea.</p> <p>Good luck and tell us how it goes if you do! =]</p></iframe>

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • No index tag robots.txt
                Nigel_Carr
                Nigel_Carr
                0
                11
                3.3k

              • How to stop robots.txt restricting access to sitemap?
                PatrickDelehanty
                PatrickDelehanty
                0
                3
                181

              • How to use robots.txt to block areas on page?
                LauraHT
                LauraHT
                0
                8
                225

              • Google indexing despite robots.txt block
                john4math
                john4math
                0
                13
                654

              • Google index dymamic webpages after block in robots.txt...
                Dr-Pete
                Dr-Pete
                0
                6
                247

              • Oh no googlebot can not access my robots.txt file
                BistosAmerica
                BistosAmerica
                0
                9
                6.3k

              • Block or remove pages using a robots.txt
                OlegKorneitchouk
                OlegKorneitchouk
                0
                2
                422

              • I have a site that has both http:// and https:// versions indexed, e.g. https://www.homepage.com/ and http://www.homepage.com/. How do I de-index the https// versions without losing the link juice that is going to the https://homepage.com/ pages?
                fthead9
                fthead9
                0
                3
                729

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy