The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Search Engine Trends
    4. Removing secure subdomain from google index

    Removing secure subdomain from google index

    Search Engine Trends
    4 4 1.7k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • marketing_zoovy.com
      marketing_zoovy.com last edited by

      we've noticed over the last few months that Google is not honoring our main website's robots.txt file.  We have added rules to disallow secure pages such as:

      Disallow: /login.cgis
      Disallow: /logout.cgis
      Disallow: /password.cgis
      Disallow: /customer/*
      
      We have noticed that google is crawling these secure pages and then duplicating our complete
      ecommerce website across our secure subdomain in the google index (duplicate content)
      
      https://secure.domain.com/etc.
      
      Our webmaster recently implemented a specific robots.txt file for the secure subdomain 
      disallow all however, these duplicated secure pages remain in the index.
      
      

      User-agent: *
      Disallow: /

      
      My question is should i request Google to remove these secure urls through Google Webmaster
      Tools?
      
      If so, is there any potential risk to my main ecommerce website?  We have 8,700 pages currently indexed
      into google and would not want to risk any ill effects to our website.
      
      How would I submit this request in the URL Removal tools specifically?  would inputting 
      https://secure.domain.com/ cover all of the urls?
      
      We do not want any secure pages being indexed to the index and all secure pages are 
      served on the secure.domain example.
      
      Please private message me for specific details if you'd like to see an example.
      
      Thank you,
      
      
      1 Reply Last reply Reply Quote 0
      • blu42media
        blu42media last edited by

        URL Removal would not be a good action in this case.  According to Google, when they remove the https version, they will also remove the http version along with it.

        How long ago did you implement the robots.txt exclusion for the https pages?  It will take Google some time to pull this from their index.  To help you can add the following on your https pages which will keep the pages from continuing to be cached:

        1 Reply Last reply Reply Quote 0
        • oznappies
          oznappies last edited by

          Do you need 8700 pages served on https? Protocol should transition when a page is ok to serve unsecured. Generally you would only serve pages on https that contain confidential information and have general content on http. If you look at the site and ask how many of those pages can a no logged in user see? If they are not protected by authorization then they do not need https as the content is publically viewable.

          1 Reply Last reply Reply Quote 0
          • KeriMorgret
            KeriMorgret last edited by

            I think you're saying you have

            mainwebsitethatsellsstuff.com
            securesubdomainof.mainwebsitethatsellsstuff.com

            and that you want to keep the main domain, and remove the subdomain, and that it's not a case of http vs https with the URL otherwise being the same, right?

            You can verify a subdomain in Google Webmaster Tools and remove the entire subdomain. I've had to do this for a dev subdomain that accidentally got indexed. I was able to keep the main domain, and remove the subdomain. The key is to verify that subdomain, and leave the main domain alone, provided I'm understanding your question correctly.

            1 Reply Last reply Reply Quote 2
            • 1 / 1
            • First post
              Last post
            • Google Search Console Not Indexing Pages
              0
              1
              73

            • Tens of duplicate homepages indexed and blocked later: How to remove from Google cache?
              vtmoz
              vtmoz
              0
              8
              70

            • Why google stop index my home page
              Andy.Drinkwater
              Andy.Drinkwater
              0
              2
              67

            • Google Index
              Martijn_Scheijbeler
              Martijn_Scheijbeler
              0
              2
              60

            • Google doesnt index my Google+ Profile
              Angelos_Savvaidis
              Angelos_Savvaidis
              0
              4
              328

            • When Google crawls and indexes a new page does it show up immediately in Google search - "site;"?
              richpalpine
              richpalpine
              0
              3
              405

            • Does Google index Wordpress pages with frames
              BradBorst
              BradBorst
              0
              3
              922

            • Why would my product pages no longer be indexed in Google?
              KeriMorgret
              KeriMorgret
              0
              9
              2.7k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy