The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Should I robots block site directories with primarily duplicate content?

    Should I robots block site directories with primarily duplicate content?

    Intermediate & Advanced SEO
    2 2 912
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • CareerBliss
      CareerBliss last edited by

      Our site, CareerBliss.com, primarily offers unique content in the form of company reviews and exclusive salary information. As a means of driving revenue, we also have a lot of job listings in ouir /jobs/ directory, as well as educational resources (/career-tools/education/) in our. The bulk of this information are feeds, which exist on other websites (duplicate). Does it make sense to go ahead and robots block these portions of our site?

      My thinking is in doing so, it will help reallocate our site authority helping the /salary/ and /company-reviews/ pages rank higher, and this is where most of the people are finding our site via search anyways.

      ie.

      http://www.careerbliss.com/jobs/cisco-systems-jobs-812156/

      http://www.careerbliss.com/jobs/jobs-near-you/?l=irvine%2c+ca&landing=true

      http://www.careerbliss.com/career-tools/education/education-teaching-category-5/

      1 Reply Last reply Reply Quote 0
      • mdoegel
        mdoegel last edited by

        Personally I'm a fan of don't block them via robots. Because if you do and you don't remove the URLs from index (remove the directory, Matt said  here ), they still will be indexed.

        There was a good posting time ago at seomoz blog and you will see, your pages won't leave the index.

        I think, you should set these pages "noindex, follow". It worked good for me.

        Patrick

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Block subdomain directory in robots.txt
          DirkC
          DirkC
          0
          5
          1.1k

        • Duplicate Multi-site Content, Duplicate URLs
          MonicaOConnor
          MonicaOConnor
          0
          2
          129

        • Duplicate content - how to diagnose duplicate content from another domain before publishing pages?
          Chemometec
          Chemometec
          0
          7
          141

        • Duplicate content within sections of a page but not full page duplicate content
          J_Sinclair
          J_Sinclair
          0
          3
          112

        • PDF on financial site that duplicates ~50% of site content
          EGOL
          EGOL
          0
          11
          392

        • What is the best way to allow content to be used on other sites for syndication without taking the chance of duplicate content filters
          irvingw
          irvingw
          0
          5
          453

        • Is my Mobile site duplicate content
          Francisco_Meza
          Francisco_Meza
          0
          3
          3.2k

        • Avoiding duplicate content on an ecommerce site
          CMoore85
          CMoore85
          0
          7
          662

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy