The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Why are these m. results showing as blocked?

    Why are these m. results showing as blocked?

    Intermediate & Advanced SEO
    3 3 75
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • nicole.healthline
      nicole.healthline last edited by

      If you go to http://bit.ly/173gdWK, you'll see that m. results are showing as blocked by robots.txt, but we don't have anything in our robots.txt file that specifies to block m. results. Any ideas why these URLs show as blocked?

      1 Reply Last reply Reply Quote 0
      • john4math
        john4math last edited by

        (Using example.com instead of your domain in case you want anonymity later)

        If you try to go to any of these m.example.com URLs on your desktop computer, you're redirected on the server to a www.example.com URL.  I'm guessing Googlebot and Googlebot-Mobile cannot access m. pages (unless you're sniffing out Googlebot-Mobile specifically to serve it m.example.com pages).  If you're looking at screen resolution for these redirects, you might not be catching Googlebot-Mobile, as I don't think Googlebot-Mobile gives a screen resolution in its user agent.  I believe you want Googlebot indexing your www. content, and Googlebot-Mobile indexing your m. content, so you'll need to sniff out Googlebot-Mobile's user agent (see here), and redirect it to m. content.

        Also of note is that I think these should be 302 temporary redirects, and not 301 permanent redirects between your www. and m. versions, as they're not really permanent, just getting a given user to the right version of the site.  Also, you don't let me switch from the mobile version to the desktop version, which drives me bananas!  Let users choose after the initial redirect.  If you allow people to switch, but maintain 301 redirects, the browsers may cache some of the redirects which will lead to weird behavior if people hit a page that redirected before.

        You don't have a robots.txt file at m.example.com/robots.txt, as that redirects to www.example.com/robots.txt even on my phone.  I don't think this is the root of the problem, but once you figure things out, you can set up a robots.txt file on your m. subdomain.

        FedeEinhorn 1 Reply Last reply Reply Quote 2
        • FedeEinhorn
          FedeEinhorn @john4math last edited by

          Yeah, I was testing exactly the same when you posted the response. I even tried crawling a googlebot-mobile and still I get the 301 redirect. Which, for everything that I am seeing it is correct, as no matter what browser I use (desktop, mobile, spider) I always get a 301 to the www. version.

          @michelleh, are you sure there's a mobile version not being redirected to the www. one?

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • Question About Permalink Showing Up in Search Results
            WebElaine
            WebElaine
            0
            2
            36

          • Search Results Pages Blocked in Robots.txt?
            BeckyKey
            BeckyKey
            0
            3
            117

          • Hey there, i'm working on search results in dutch.
            MattRoney
            MattRoney
            0
            7
            139

          • Site: search showing funny results
            Stramark
            Stramark
            0
            4
            108

          • Why is my page not showing in Google results
            KevinBudzynski
            KevinBudzynski
            0
            4
            158

          • Mobile search results show desktop crawled content
            KristinaKledzik
            KristinaKledzik
            0
            14
            313

          • Why are these results being showed as blocked by robots.txt?
            eyepaq
            eyepaq
            0
            9
            203

          • How to show country name in google search result
            Alick300
            Alick300
            0
            5
            421

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy