The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Moz Tools
    4. To block with robots.txt or canonicalize?

    To block with robots.txt or canonicalize?

    Moz Tools
    2 2 522
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • JonClark15
      JonClark15 last edited by

      I'm working with an apt community with a large number of communities across the US. I'm running into dup content issues where each community will have a page such as "amenities" or "community-programs", etc that are nearly identical (if not exactly identical) across all communities.

      I'm wondering if there are any thoughts on the best way to tackle this. The two scenarios I came up with so far are:

      Is it better for me to select the community page with the most authority and put a canonical on all other community pages pointing to that authoritative page?

      or

      Should i just remove the directory all-together via robots.txt to help keep the site lean and keep low quality content from impacting the site from a panda perspective?

      Is there an alternative I'm missing?

      1 Reply Last reply Reply Quote 0
      • STPseo
        STPseo last edited by

        I think the canonical idea is better than blocking the pages all together. Depending on how the site is laid out you may try and make the pages more specific to location being talked about. Maybe adding header tags with the location information as well as adding that info to the page title and meta-description. If it is not too time consuming, I'd try and make those pages more unique especially since you might be getting searches based on a location. Location specific pages may help in that regard.

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Robots.txt file issues on Shopify server
          Expansyon
          Expansyon
          0
          2
          44

        • Robots.txt blocking Moz
          ChristinaRadisic
          ChristinaRadisic
          0
          6
          291

        • Block Moz (or any other robot) from crawling pages with specific URLs
          Blacktie
          Blacktie
          0
          3
          844

        • Meta-Robots noFollow and Blocked by Meta-Robots
          gfiedel
          gfiedel
          0
          4
          223

        • Does Rogerbot respect the robots.txt file for wildcards?
          AC_Pro
          AC_Pro
          0
          4
          574

        • Seomoz bar: No Follow and Robots.txt
          squareplug
          squareplug
          0
          7
          1.3k

        • How to get rid of the message "Search Engine blocked by robots.txt"
          1prashakth
          1prashakth
          0
          7
          1.1k

        • Why is Roger crawling pages that are disallowed in my robots.txt file?
          MeltButterySpread
          MeltButterySpread
          0
          5
          928

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy