The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Best practice to prevent pages from being indexed?

    Best practice to prevent pages from being indexed?

    Intermediate & Advanced SEO
    2 2 64
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • TheaterMania
      TheaterMania last edited by

      Generally speaking, is it better to use robots.txt or rel=noindex to prevent duplicate pages from being indexed?

      1 Reply Last reply Reply Quote 0
      • Andy-Halliday
        Andy-Halliday last edited by

        Isn't the main question: Why do you have duplicate pages, are these essentials - the easiest option would be to remove them. But in terms of whats the best option, here is a great article from Moz: http://moz.com/learn/seo/robotstxt

        I would read that and decide based on your websites and situation the option best suits you.

        In my opinion I would suggest:

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Best practice for deindexing large quantities of pages
          LoganRay
          LoganRay
          0
          4
          311

        • How do we decide which pages to index/de-index? Help for a 250k page site
          julie-getonthemap
          julie-getonthemap
          0
          2
          63

        • What is best practice for "Sorting" URLs to prevent indexing and for best link juice ?
          katemorris
          katemorris
          0
          6
          1.4k

        • Index Pages become No-Index
          TimKelsey
          TimKelsey
          0
          6
          114

        • Best practice for the brand name in Page Titles
          AndreVanKets
          AndreVanKets
          0
          5
          298

        • Best practice for removing indexed internal search pages from Google?
          italominano
          italominano
          0
          4
          2.8k

        • Why are new pages not being indexed, and old pages (now in robots.txt) remain in the index?
          KeriMorgret
          KeriMorgret
          0
          3
          378

        • There's a website I'm working with that has a .php extension. All the pages do. What's the best practice to remove the .php extension across all pages?
          digisavvy
          digisavvy
          0
          5
          445

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy