The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Google is indexing my directories

    Google is indexing my directories

    Technical SEO Issues
    4 3 419
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • UnderRugSwept
      UnderRugSwept last edited by

      I'm sure this has been asked before, but I was looking at all of Google's results for my site and I found dozens of results for directories such as:

      Index of /scouting/blog/wp-includes/js/swfupload/plugins

      Obviously I don't want those indexed. How do I prevent Google from indexing those?

      Also, it only seems to be doing it with Wordpress, not any of the directories on my main site. (We have a wordpress blog, which is only a portion of the site)

      1 Reply Last reply Reply Quote 0
      • Mr.Rangen
        Mr.Rangen last edited by

        Here are your options:

        1. Robots.txt - http://support.google.com/webmasters/bin/answer.py?hl=en&answer=93708 - easy option.
        2. Noindex tags - http://www.mattcutts.com/blog/google-noindex-behavior/
        3. Removal request - https://support.google.com/webmasters/bin/answer.py?hl=en&answer=59819
        1 Reply Last reply Reply Quote 1
        • irvingw
          irvingw last edited by

          To elaborate a little on what he said

          a) yes block the folders with content you don't want indexed in robots.txt - but that is not enough you need to add the noindex to the pages as well for an extra measure.

          b) get the YOAST seo plugin for wordpress installed on your site and configure it to follow,noindex these page. look at other sections you don't want indexed too like tag pages. This plugin is easy to use and will help suggest default settings.

          c) yes you can go into WMT to request removal of specific folders and urls and Google will quickly get them out of the index for you instead of waiting for them to age away.  Your robots.txt should be in place before doing this to make sure it's permanent.

          UnderRugSwept 1 Reply Last reply Reply Quote 0
          • UnderRugSwept
            UnderRugSwept @irvingw last edited by

            Thanks for expanding on that!

            a) There are no pages in these folders; they're just directories full of Wordpress config stuff

            b) I already have Yoast and have tag pages noindexed. All the directories I'm referring to are similar to the path I showed above.

            c) If I request removal of specific folders, will it also remove all the files within the folder?\

            Thanks!

            1 Reply Last reply Reply Quote 0
            • 1 / 1
            • First post
              Last post
            • Will a Robots.txt 'disallow' of a directory, keep Google from seeing 301 redirects for pages/files within the directory?
              DmitriiK
              DmitriiK
              0
              4
              408

            • What's going on with google index - javascript and google bot
              Everett
              Everett
              0
              4
              475

            • Anything new if determining how many of a sites pages are in Google's supplemental index vs the main index?
              SEMPassion
              SEMPassion
              0
              4
              390

            • Page disappeared from Google index. Google cache shows page is being redirected.
              shop.nordstrom
              shop.nordstrom
              0
              5
              761

            • Google webmaster showing 0 indexed, yet I can see them all them Google search?
              Martijn_Scheijbeler
              Martijn_Scheijbeler
              0
              4
              102

            • Why is "FTP Directory Listing" included in our Title in Google Search Results Index
              hasansplace
              hasansplace
              0
              8
              600

            • Google Indexing
              SilbertAd
              SilbertAd
              0
              4
              612

            • Will Google Continue to Index the Page with NoIndex Tag Upon Google +1 Button Impression or Click?
              STPseo
              STPseo
              0
              3
              636

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy