The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Robots.txt

    Robots.txt

    Technical SEO Issues
    9 4 168
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • iskq
      iskq last edited by

      Google Webmaster Tools say our website's have low-quality pages, so we have created a robots.txt file and listed all URL’s that we want to remove from Google index.

      Is this enough for the solve problem?

      1 Reply Last reply Reply Quote 0
      • jesse-landry
        jesse-landry last edited by

        Why not improve the pages, instead?

        If Google says they are low quality, what makes you think any viewer will stick around? Bet the bounce rate is exceptionally high on those pages, maybe even site-wide.

        Always remember to design pages for readers and not Google. If Google tells you your pages suck, they are probably just trying to help you and give you a hint that it's time to improve your site.

        iskq 1 Reply Last reply Reply Quote 0
        • Davenport-Tractor
          Davenport-Tractor last edited by

          Iskender.

          Our experience has been YES. Google does follow your Robots.txt file and will ignore indexing those pages. If they have a problem, the problem will disappear.

          My concern is, what is causing the "Low-quality" error message? In the long run, wouldn't it be better to correct the page to improve the quality? I look at each page as a way to qualify for a greater number of keywords, hence attracting more attention for your website.

          We have had several pages flagged as duplicate content, when we never wanted the duplicate page indexed anyway. Once we included the page in the Robots.txt file the flagged error disappeared.

          1 Reply Last reply Reply Quote 0
          • iskq
            iskq @jesse-landry last edited by

            Our site is a home to home moving listing portal. Consumers who wants to move his home fills a form so that moving companies can cote prices.  We were generating listing page URL’s by using the title submitted by customer. Unfortunately we have understood by now that many customers have entered same content.

            jesse-landry 1 Reply Last reply Reply Quote 0
            • WesleySmits
              WesleySmits last edited by

              I agree with Jesse and Allen.

              Of course the problems in Google Webmaster Tools will disappear by no-indexing it.
              Low quality pages isn't a good thing for visitors either.

              It's difficult to give you any other advice then the very broad advise: Improve the quality of the pages.
              If you could give us some links to let us know which website and which pages we're talking about then we could give you a better advice on how exactly you can improve those pages.

              iskq 1 Reply Last reply Reply Quote 0
              • jesse-landry
                jesse-landry @iskq last edited by

                Well now I'm confused on the problem.. If the issue is duplicate content then the answer is definitely to block them with robots and/or use a rel=canonical tag on each.

                However, the Google notice you are referencing has nothing to do with duplicate content notices to my knowledge.

                There is always a way to improve your content. Filling out a form auto-generates a page, per my understanding. Great. Have it auto-generate a better looking page!

                -my 2 cents. hope it's helpful.

                1 Reply Last reply Reply Quote 0
                • iskq
                  iskq @WesleySmits last edited by

                  Thank You Wesley,

                  Here our pages but language is Turkish,

                  http://www.enakliyat.com.tr/detaylar/besiktas-basaksehir-ev-esyasi-tasinma-6495

                  http://www.enakliyat.com.tr/detaylar/ev-tasima-6503

                  http://www.enakliyat.com.tr/detaylar/evden-eve-nakliyat-6471

                  Our site is a home to home moving listing portal. Consumers who wants to move his home fills a form so that moving companies can cote prices.  We were generating listing page URL’s by using the title submitted by customer. Unfortunately we have understood by now that many customers have entered same content.

                  WesleySmits 1 Reply Last reply Reply Quote 0
                  • jesse-landry
                    jesse-landry last edited by

                    Yeah that's definitely a duplicate content issue you're facing.

                    However, did you know that each of your pages have this little tag right at the top of them? name="robots" content="noindex" />

                    ...Seems like it's already done.

                    1 Reply Last reply Reply Quote 1
                    • WesleySmits
                      WesleySmits @iskq last edited by

                      Ah, it's difficult to see anything on the page because i can't read Turkish.

                      The only thing you should know is that every single page in a website should have unique content. So if two pages are exactly or almost exactly the same then Google will think it's duplicate content.

                      1 Reply Last reply Reply Quote 0
                      • 1 / 1
                      • First post
                        Last post
                      • Robots.txt
                        Dan-Lawrence
                        Dan-Lawrence
                        0
                        5
                        99

                      • Robots txt
                        LadyApollo
                        LadyApollo
                        0
                        3
                        427

                      • Robots.txt question
                        RobMay
                        RobMay
                        0
                        5
                        307

                      • Robots.txt question
                        KeriMorgret
                        KeriMorgret
                        0
                        7
                        791

                      • Blocking robots.txt
                        de4e
                        de4e
                        0
                        4
                        432

                      • Robots.txt
                        Entrusteddev
                        Entrusteddev
                        0
                        3
                        642

                      • Robots.txt and robots meta
                        TheEspresseo
                        TheEspresseo
                        0
                        5
                        1.1k

                      • Robots.txt
                        Tom-Anthony
                        Tom-Anthony
                        0
                        4
                        1.1k

                      Get started with Moz Pro!

                      Unlock the power of advanced SEO tools and data-driven insights.

                      Start my free trial
                      Products
                      • Moz Pro
                      • Moz Local
                      • Moz API
                      • Moz Data
                      • STAT
                      • Product Updates
                      Moz Solutions
                      • SMB Solutions
                      • Agency Solutions
                      • Enterprise Solutions
                      • Digital Marketers
                      Free SEO Tools
                      • Domain Authority Checker
                      • Link Explorer
                      • Keyword Explorer
                      • Competitive Research
                      • Brand Authority Checker
                      • Local Citation Checker
                      • MozBar Extension
                      • MozCast
                      Resources
                      • Blog
                      • SEO Learning Center
                      • Help Hub
                      • Beginner's Guide to SEO
                      • How-to Guides
                      • Moz Academy
                      • API Docs
                      About Moz
                      • About
                      • Team
                      • Careers
                      • Contact
                      Why Moz
                      • Case Studies
                      • Testimonials
                      Get Involved
                      • Become an Affiliate
                      • MozCon
                      • Webinars
                      • Practical Marketer Series
                      • MozPod
                      Connect with us

                      Contact the Help team

                      Join our newsletter
                      Moz logo
                      © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                      • Accessibility
                      • Terms of Use
                      • Privacy