The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Best solution to get mass URl's out the SE's index

    Best solution to get mass URl's out the SE's index

    Intermediate & Advanced SEO
    3 2 583
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • James77
      James77 last edited by

      Hi,

      I've got an issue where our web developers have made a mistake on our website by messing up some URL's . Because our site works dynamically IE the URL's generated on a page are relevant to the current URL it ment the problem URL linked out to more problem URL's - effectively replicating an entire website directory under problem URL's - this has caused tens of thousands of URL's in SE's indexes which shouldn't be there.

      So say for example the problem URL's are like

      www.mysite.com/incorrect-directory/folder1/page1/

      It seems I can correct this by doing the following:

      1/. Use Robots.txt  to disallow access to /incorrect-directory/*

      2/. 301 the urls like this:
      www.mysite.com/incorrect-directory/folder1/page1/
      301 to:
      www.mysite.com/correct-directory/folder1/page1/

      3/. 301 URL's to the root correct directory like this:
      www.mysite.com/incorrect-directory/folder1/page1/
      www.mysite.com/incorrect-directory/folder1/page2/
      www.mysite.com/incorrect-directory/folder2/

      301 to:
      www.mysite.com/correct-directory/

      Which method do you think is the best solution? - I doubt there is any link juice benifit from 301'ing URL's as there shouldn't be any external links pointing to the wrong URL's.

      1 Reply Last reply Reply Quote 0
      • RyanKent
        RyanKent last edited by

        Option 2 is preferred.

        You definitely do not want to use the robots.txt method. In general, avoid using robots.txt unless there are no other options.

        Whenever your site's visitors have a link to an invalid URL, 301 them to the correct URL if you have the content they are seeking. It creates the best user experience and the best SEO results.

        James77 1 Reply Last reply Reply Quote 1
        • James77
          James77 @RyanKent last edited by

          Cheers Ryan.

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • How to get a large number of urls out of Google's Index when there are no pages to noindex tag?
            effectdigital
            effectdigital
            0
            2
            50

          • What's the best URL structure?
            MoosaHemani
            MoosaHemani
            0
            4
            281

          • URL Injection Hack - What to do with spammy URLs that keep appearing in Google's index?
            Dezzign
            Dezzign
            0
            7
            3.6k

          • Duplicate content URLs from bespoke ecommerce CMS - what's the best solution here?
            TimHolmes
            TimHolmes
            0
            2
            92

          • How can I get a list of every url of a site in Google's index?
            KaneJamison
            KaneJamison
            0
            8
            1.1k

          • Is there any negative SEO effect of having comma's in URL's?
            gcdtechnologies
            gcdtechnologies
            0
            3
            2.6k

          • Most Painless way of getting Duff Pages out of SE's Index
            RyanKent
            RyanKent
            0
            3
            576

          • Don't want to lose page rank, what's the best way to restructure a url other than a 301 redirect?
            marig
            marig
            0
            6
            1.0k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy