The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Robots.txt and 301

    Robots.txt and 301

    Technical SEO Issues
    5 2 427
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Bush_JSM
      Bush_JSM last edited by

      Hi Mozzers,

      Can you answer something for me please.

      I have a client and they have 301 re-directed the homepage '/' to '/home.aspx'.

      Therefore all or most of the linkjuice is being passed which is great. They have also marked the '/' as nofollow / noindex in the Robots.txt file so its not being crawled.

      My question is if the '/' is being denied access to the robots is it still passing on the authority for the links that go into this page? It is a 301 and not 302 so it would work under normal circumstances but as the page is not being crawled do I need to change the Robots.txt to crawl the '/'?

      Thanks

      Bush

      1 Reply Last reply Reply Quote 0
      • YannickVeys
        YannickVeys last edited by

        I would suggest not excluding the / in the robots.txt.

        First you redirect the / to home.aspx but then you tell SE's to exclude the home page which you are redirecting anyway. Makes no sense to me, so I would remove it in the robots.txt. No use anyway, because the url is being redirected.

        I wouldn't use the 301 redirect to home.aspx. Why not make some (technical?) modifications so that the home page is available on the root of the domain? It's much more beneficial to you site's SEO. Or the other way around, redirect home.aspx to /. Because way more ppl will be linking to the root and not the home.aspx page.

        Bush_JSM 1 Reply Last reply Reply Quote 0
        • Bush_JSM
          Bush_JSM @YannickVeys last edited by

          Hi Yannick.

          Thanks for your reply. The / redirect to /home redirect has been done and the / is excluded.

          I'm limited as to what changes I can make. I can amend the robots.txt to crawl / which is 301's to /home and that way the links will be attributed and the 301 remains.

          Will that be beneficial do you think?

          Bush

          YannickVeys Bush_JSM 2 Replies Last reply Reply Quote 0
          • YannickVeys
            YannickVeys @Bush_JSM last edited by

            Yes. 🙂 Remove the noindex nofollow for / from the robots.txt. It doesn't add anything. It can only confuse SE's and lose you rankings.

            1 Reply Last reply Reply Quote 1
            • Bush_JSM
              Bush_JSM @Bush_JSM last edited by

              Thanks Yannick - really helpful

              cheers and have a good weekend

              Bush

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Robots txt. in page with 301 redirect
                LauraSultan
                LauraSultan
                0
                6
                3.1k

              • Robots.txt
                MarieHaynes
                MarieHaynes
                0
                8
                115

              • To 301 or not to 301?
                seorocket
                seorocket
                0
                3
                91

              • Robots.txt
                WesleySmits
                WesleySmits
                0
                9
                168

              • Robots.txt
                irvingw
                irvingw
                0
                4
                116

              • Site blocked by robots.txt and 301 redirected still in SERPs
                OlegKorneitchouk
                OlegKorneitchouk
                0
                2
                621

              • Robots.txt
                BailHotline
                BailHotline
                0
                5
                760

              • Robots.txt
                Ontarioseo
                Ontarioseo
                0
                5
                737

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy