The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Title errors for pages behind a login

    Title errors for pages behind a login

    Technical SEO Issues
    2 2 213
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • digitalez
      digitalez last edited by

      On our website we have content which is located behind a members login.

      the SEOMoz crawl report has returned these pages with a "no title" error against them.

      It appears that these pages are being crawled until the website prompts it to login. I can only presume that it follows the url but doesn't have an opportunity to crawl the meta data.

      what is the solution for these pages?

      401, so that the bots know these pages are behind a login?

      do we implement anything to ensure "no index", "no follow"?

      I searched the T'interwebs and couldn't find anything conclusive on this issue.

      1 Reply Last reply Reply Quote 0
      • Marcus_Miller
        Marcus_Miller last edited by

        Well, I guess if these are secure pages the correct approach would be the HTTP 403 status code (Forbidden). For example, this is the way apache forbids access to PHPMyAdmin if you have set up IP filtering in PHPMyAdmin.conf. I am not entirely sure how your security is implemented or how the SEOMoz crawler deals with a 403 but it should just back off from these pages.

        Alternatively, if your URL structure allows it, you could block the SEOMoz crawler from these pages in robots.txt. Assuming your secure pages were in a directory called /secure/ we would need:

        User-agent: rogerbot Disallow: /secure/

        Hope that helps!
        Marcus

        1 Reply Last reply Reply Quote 0
        • 1 / 1
        • First post
          Last post
        • Very wierd pages. 2900 403 errors in page crawl for a site that only has 140 pages.
          H.M.N.
          H.M.N.
          0
          6
          64

        • Duplicate Page Titles Issue in Campaign Crawl Error Report
          Rich-DC
          Rich-DC
          0
          3
          76

        • Titling Category Pages Like You Would a Blog Page?
          TheCraig
          TheCraig
          0
          3
          47

        • Page titles in browser not matching WP page title
          Doc_Sheldon
          Doc_Sheldon
          0
          6
          223

        • 404 error due to a page which requires a login
          MikeRoberts
          MikeRoberts
          0
          2
          97

        • Duplicate Page Title Crawl Error Issue
          TakeshiYoung
          TakeshiYoung
          0
          3
          176

        • Translating Page Titles & Page Descriptions
          cfguti
          cfguti
          0
          2
          219

        • Pdf page titles and descriptions errors
          ChiarynMiranda
          ChiarynMiranda
          0
          4
          442

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy