The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Adding directories to robots nofollow cause pages to have Blocked Resources

    Adding directories to robots nofollow cause pages to have Blocked Resources

    Technical SEO Issues
    2 2 123
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • miamiman100
      miamiman100 last edited by

      In order to eliminate duplicate/missing title tag errors for a directory (and sub-directories) under www that contain our third-party chat scripts, I added the parent directory to the robots disallow list.

      We are now receiving a blocked resource error (in Webmaster Tools) on all of the pages that have a link to a javascript (for live chat) in the parent directory.

      My host is suggesting that the warning is only a notice and we can leave things as is without worrying about the page being de-ranked/penalized.

      I am wondering if this is true or if we should remove the one directory that contains the js from the robots file and find another way to resolve the duplicate title tags?

      1 Reply Last reply Reply Quote 0
      • PatrickDelehanty
        PatrickDelehanty last edited by

        Hi there

        Don't block pages or directories because they have duplicate/missing titles - instead, fix them - those pages may provide value and you could be missing some big opportunities.

        "...we can leave things as is without worrying about the page being de-ranked/penalized." - you're blocking the page in your robots.txt, so you're already not being indexed. If you are looking to index these pages, you need to remove that robots.txt.

        Go through, assess your titles and page content, and change your titles to be uniquely relevant to the content on that page. If you have the opportunity as well, do a content audit to see if pages can be condensed or expanded.

        Hope this all helps! Good luck!

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Blocking pages from Moz and Alexa robots
          Xiano
          Xiano
          0
          3
          97

        • Will a Robots.txt 'disallow' of a directory, keep Google from seeing 301 redirects for pages/files within the directory?
          DmitriiK
          DmitriiK
          0
          4
          408

        • Do I need to block my cart page in robots.txt?
          Hutch42
          Hutch42
          0
          3
          2.4k

        • Why are the bots still picking up so many links on our page despite us adding nofollow?
          DanaLookadoo
          DanaLookadoo
          0
          13
          197

        • How should I organize my pages? Directory or no directory?
          evolvingSEO
          evolvingSEO
          0
          3
          298

        • Blocked by meta-robots but there is no robots file
          Twinbytes
          Twinbytes
          0
          9
          700

        • Warnings for blocked by blocked by meta-robots/meta robots Nofollow...how to resolve?
          Cyrus-Shepard
          Cyrus-Shepard
          0
          3
          415

        • What can be the cause of my inner pages ranking higher than my home page?
          deciph22
          deciph22
          0
          16
          5.0k

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy