The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Adding directories to robots nofollow cause pages to have Blocked Resources

    Adding directories to robots nofollow cause pages to have Blocked Resources

    Technical SEO Issues
    2 2 123
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • miamiman100
      miamiman100 last edited by

      In order to eliminate duplicate/missing title tag errors for a directory (and sub-directories) under www that contain our third-party chat scripts, I added the parent directory to the robots disallow list.

      We are now receiving a blocked resource error (in Webmaster Tools) on all of the pages that have a link to a javascript (for live chat) in the parent directory.

      My host is suggesting that the warning is only a notice and we can leave things as is without worrying about the page being de-ranked/penalized.

      I am wondering if this is true or if we should remove the one directory that contains the js from the robots file and find another way to resolve the duplicate title tags?

      1 Reply Last reply Reply Quote 0
      • PatrickDelehanty
        PatrickDelehanty last edited by

        Hi there

        Don't block pages or directories because they have duplicate/missing titles - instead, fix them - those pages may provide value and you could be missing some big opportunities.

        "...we can leave things as is without worrying about the page being de-ranked/penalized." - you're blocking the page in your robots.txt, so you're already not being indexed. If you are looking to index these pages, you need to remove that robots.txt.

        Go through, assess your titles and page content, and change your titles to be uniquely relevant to the content on that page. If you have the opportunity as well, do a content audit to see if pages can be condensed or expanded.

        Hope this all helps! Good luck!

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Shopify robots blocking stylesheets causing inconsistent mobile-friendly test results?
          zeehj
          zeehj
          0
          3
          60

        • Google is Still Blocking Pages Unblocked 1 Month ago in Robots
          Tyler123
          Tyler123
          0
          3
          131

        • Do I need to block my cart page in robots.txt?
          Hutch42
          Hutch42
          0
          3
          2.4k

        • Should I block Map pages with robots.txt?
          imaginex
          imaginex
          0
          3
          73

        • HTTP Status showing up in opensiteexplorer top pages as blocked by robot.txt file
          FedeEinhorn
          FedeEinhorn
          0
          2
          106

        • "Extremely high number of URLs" warning for robots.txt blocked pages
          KristinaKledzik
          KristinaKledzik
          0
          8
          380

        • Do you get credit for an external link that points to a page that's being blocked by robots.txt
          ShaMenz
          ShaMenz
          0
          2
          390

        • Search Engine Blocked by Robot Txt warnings for Filter Search result pages--Why?
          languedoc
          languedoc
          0
          5
          915

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy