The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Severe Health issue on my site through Webmaster tools

    Severe Health issue on my site through Webmaster tools

    Technical SEO Issues
    31 4 2.3k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • VictorVC
      VictorVC last edited by

      I use Go Daddy Website Tonight. I keep getting a severe health message in Google Webmaster tools stating that my robots.txt file is blocking some important page. When I try to get more details the blocked file will not open. When I asked the Go Daddy peeps they told me that it was just image and backup files that do not need to be crawled. But if Google spiders keep thinking an important page is blocked will this hurt my SERPS?

      1 Reply Last reply Reply Quote 0
      • SEOExecutive20
        SEOExecutive20 last edited by

        From what I know, Godaddy Website Tonight does not offer you the opportunity to create a custom robots.txt.  I believe you have to sign up for there Search Engine Visibility services. Here is some more information: http://support.godaddy.com/help/article/5321

        VictorVC 2 Replies Last reply Reply Quote 2
        • VictorVC
          VictorVC @SEOExecutive20 last edited by

          Yes you are correct. I forgot to mention (sorry) that I do use S.E.V. It allows you to create a robots.txt and lets you choose pages to block. However, even when you choose allow all, by default it blocks certain files. Go Daddy tells me they are only system files but Google tells me an important page is blocked.

          1 Reply Last reply Reply Quote 0
          • VictorVC
            VictorVC @SEOExecutive20 last edited by

            Below is the robots.txt Website Tonight Creates when I tell it to allow all pages:

            User-agent: *
            Allow: /
            User-agent: *
            Disallow: /cache/
            Disallow: /_backup/
            Disallow: /_mygallery/
            Disallow: /_temp/
            Disallow: /_tempalbums/
            Disallow: /_tmpfileop/
            Disallow: /dbboon/
            Disallow: /Flash/
            Disallow: /images/
            Disallow: /plugins/
            Disallow: /scripts/
            Disallow: /stats/
            Disallow: /statshistory/
            Disallow: /WstxSearchResults.html
            Disallow: /WstxSearchResults.php
            Disallow: /QSC/

            SEOExecutive20 VictorVC 4 Replies Last reply Reply Quote 0
            • SEOExecutive20
              SEOExecutive20 @VictorVC last edited by

              Can you place the following in your browser and replace website with your domain name and www or non www in front.  website.com/robots.txt

              Let me know if you see the same stuff you sent me in your last response

              1 Reply Last reply Reply Quote 0
              • VictorVC
                VictorVC @VictorVC last edited by

                Yes. When I type www.shakes4life.com/robots.txt the same list shows.

                1 Reply Last reply Reply Quote 0
                • VictorVC
                  VictorVC @VictorVC last edited by

                  Is there something on it that would be detrimental to my SERPS?

                  1 Reply Last reply Reply Quote 0
                  • SEOExecutive20
                    SEOExecutive20 @VictorVC last edited by

                    Is Google webmaster tools giving you the specific name of the files that are being blocked?

                    1 Reply Last reply Reply Quote 0
                    • SEOExecutive20
                      SEOExecutive20 last edited by

                      When did Google last index your site? You can check this through webmaster tools. When did you instal the robots.txt file.  The reason I ask: If Google's last crawl was before you uploaded your robots file then that could be the issue.  Please look at these statistics and verify this before we move further.

                      VictorVC 1 Reply Last reply Reply Quote 0
                      • SEOExecutive20
                        SEOExecutive20 last edited by

                        Also, the following are duplicates: http://www.shakes4life.com/shakeology.html  & http://www.shakes4life.com

                        VictorVC 2 Replies Last reply Reply Quote 0
                        • VictorVC
                          VictorVC @SEOExecutive20 last edited by

                          It was just crawled. And it was after robots.txt was uploaded. This is the page it lists: siteUtil.js

                          SEOExecutive20 VictorVC 3 Replies Last reply Reply Quote 0
                          • SEOExecutive20
                            SEOExecutive20 @VictorVC last edited by

                            This is a javascript file and I don't see it being an issue unless Google thinks your hiding it to be spammy .  Also, there are some that say it's a benefit to block js files from the search  for SEO purposes. Here is an example of that situation: http://www.seomofo.com/advanced/do-not-let-google-crawl-javascript.html  I think since this is out of your control and goes by the standard of how Godaddy sets up there sites, then it shouldn't be an issue.

                            1 Reply Last reply Reply Quote 0
                            • VictorVC
                              VictorVC @VictorVC last edited by

                              Oh OK great. Thanks so much for your help. I just got nervous because Google puts up the Severe Health Issue warning everytime I get crawled.

                              1 Reply Last reply Reply Quote 0
                              • SEOExecutive20
                                SEOExecutive20 @VictorVC last edited by

                                Your welcome! I'm also sending the other side of the story not to confuse you but to allow you to make a decision based on both sides:  http://groups.google.com/a/googleproductforums.com/forum/#!category-topic/webmasters/crawling-indexing--ranking/8nyxCtv9RHM

                                1 Reply Last reply Reply Quote 0
                                • VictorVC
                                  VictorVC @SEOExecutive20 last edited by

                                  Yes thanks. I foolishly renamed my home page and caused a duplicate page. Website tonight will not allow me to do a 301 redirect. I put a canonical tag on the /shakeology. Should this do the trick?

                                  1 Reply Last reply Reply Quote 0
                                  • VictorVC
                                    VictorVC @SEOExecutive20 last edited by

                                    Since I can't 301 it, would it be bad to delete the dupe page?

                                    SEOExecutive20 VictorVC 4 Replies Last reply Reply Quote 0
                                    • SEOExecutive20
                                      SEOExecutive20 @VictorVC last edited by

                                      Personally, that's what I would do is delete it.  Unless, there is a reason you need that page.

                                      1 Reply Last reply Reply Quote 0
                                      • VictorVC
                                        VictorVC @VictorVC last edited by

                                        I really do appreciate all of your help. Here's the issue I'm having with this though... After I renamed the homepage file to add /shakeology.html to it (because I thought it would be beneficial to have a main keyword in the url) Website Tonight only shows me the homepage.com/shakeology.html and not the homepage.com. I'm afraid that if I delete /shakeology.html I will show neither one and in essence, according to Website Tonight just be deleting my homepage. I'm not sure how to properly accomplish what I'm looking to do without screwing myself any further??

                                        1 Reply Last reply Reply Quote 0
                                        • SEOExecutive20
                                          SEOExecutive20 @VictorVC last edited by

                                          I found some great info here that I believe explains it: http://support.godaddy.com/help/2986/organizing-your-website-using-the-organize-site-page

                                          1 Reply Last reply Reply Quote 0
                                          • VictorVC
                                            VictorVC @VictorVC last edited by

                                            Yes I saw that but unfortunately the organize your site page on website tonight only shows the new page. I'm afraid to delete it and lose both.

                                            1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 1 / 2
                                            • First post
                                              Last post
                                            • Manual Webspam Error. Same Penalty on all sites on Webmaster Tools account.
                                              ndroidgalaxy
                                              ndroidgalaxy
                                              0
                                              7
                                              189

                                            • Webmaster Tools stopped updating my sites
                                              Banknotes
                                              Banknotes
                                              0
                                              5
                                              137

                                            • Webmaster Tools - How to Change Site Owner When Owner is MIA
                                              Clickatell2
                                              Clickatell2
                                              0
                                              4
                                              2.8k

                                            • Has anyone had problems with google webmaster tools verified sites
                                              ClaireH-184886
                                              ClaireH-184886
                                              0
                                              4
                                              183

                                            • Recent Webmaster Tools Glitch Impacting Site Quality?
                                              0
                                              1
                                              585

                                            • Webmaster Tools Site Map Question
                                              SEODinosaur
                                              SEODinosaur
                                              0
                                              6
                                              490

                                            • All of my incoming links to my site are gone in Webmaster Tools!?
                                              Benj25
                                              Benj25
                                              0
                                              3
                                              1.1k

                                            • Issue with 'Crawl Errors' in Webmaster Tools
                                              RiceMedia
                                              RiceMedia
                                              0
                                              4
                                              782

                                            Get started with Moz Pro!

                                            Unlock the power of advanced SEO tools and data-driven insights.

                                            Start my free trial
                                            Products
                                            • Moz Pro
                                            • Moz Local
                                            • Moz API
                                            • Moz Data
                                            • STAT
                                            • Product Updates
                                            Moz Solutions
                                            • SMB Solutions
                                            • Agency Solutions
                                            • Enterprise Solutions
                                            • Digital Marketers
                                            Free SEO Tools
                                            • Domain Authority Checker
                                            • Link Explorer
                                            • Keyword Explorer
                                            • Competitive Research
                                            • Brand Authority Checker
                                            • Local Citation Checker
                                            • MozBar Extension
                                            • MozCast
                                            Resources
                                            • Blog
                                            • SEO Learning Center
                                            • Help Hub
                                            • Beginner's Guide to SEO
                                            • How-to Guides
                                            • Moz Academy
                                            • API Docs
                                            About Moz
                                            • About
                                            • Team
                                            • Careers
                                            • Contact
                                            Why Moz
                                            • Case Studies
                                            • Testimonials
                                            Get Involved
                                            • Become an Affiliate
                                            • MozCon
                                            • Webinars
                                            • Practical Marketer Series
                                            • MozPod
                                            Connect with us

                                            Contact the Help team

                                            Join our newsletter
                                            Moz logo
                                            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                            • Accessibility
                                            • Terms of Use
                                            • Privacy