The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. Severe Health issue on my site through Webmaster tools

    Severe Health issue on my site through Webmaster tools

    Technical SEO Issues
    31 4 2.3k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • VictorVC
      VictorVC @SEOExecutive20 last edited by

      Yes you are correct. I forgot to mention (sorry) that I do use S.E.V. It allows you to create a robots.txt and lets you choose pages to block. However, even when you choose allow all, by default it blocks certain files. Go Daddy tells me they are only system files but Google tells me an important page is blocked.

      1 Reply Last reply Reply Quote 0
      • VictorVC
        VictorVC @SEOExecutive20 last edited by

        Below is the robots.txt Website Tonight Creates when I tell it to allow all pages:

        User-agent: *
        Allow: /
        User-agent: *
        Disallow: /cache/
        Disallow: /_backup/
        Disallow: /_mygallery/
        Disallow: /_temp/
        Disallow: /_tempalbums/
        Disallow: /_tmpfileop/
        Disallow: /dbboon/
        Disallow: /Flash/
        Disallow: /images/
        Disallow: /plugins/
        Disallow: /scripts/
        Disallow: /stats/
        Disallow: /statshistory/
        Disallow: /WstxSearchResults.html
        Disallow: /WstxSearchResults.php
        Disallow: /QSC/

        SEOExecutive20 VictorVC 4 Replies Last reply Reply Quote 0
        • SEOExecutive20
          SEOExecutive20 @VictorVC last edited by

          Can you place the following in your browser and replace website with your domain name and www or non www in front.  website.com/robots.txt

          Let me know if you see the same stuff you sent me in your last response

          1 Reply Last reply Reply Quote 0
          • VictorVC
            VictorVC @VictorVC last edited by

            Yes. When I type www.shakes4life.com/robots.txt the same list shows.

            1 Reply Last reply Reply Quote 0
            • VictorVC
              VictorVC @VictorVC last edited by

              Is there something on it that would be detrimental to my SERPS?

              1 Reply Last reply Reply Quote 0
              • SEOExecutive20
                SEOExecutive20 @VictorVC last edited by

                Is Google webmaster tools giving you the specific name of the files that are being blocked?

                1 Reply Last reply Reply Quote 0
                • SEOExecutive20
                  SEOExecutive20 last edited by

                  When did Google last index your site? You can check this through webmaster tools. When did you instal the robots.txt file.  The reason I ask: If Google's last crawl was before you uploaded your robots file then that could be the issue.  Please look at these statistics and verify this before we move further.

                  VictorVC 1 Reply Last reply Reply Quote 0
                  • SEOExecutive20
                    SEOExecutive20 last edited by

                    Also, the following are duplicates: http://www.shakes4life.com/shakeology.html  & http://www.shakes4life.com

                    VictorVC 2 Replies Last reply Reply Quote 0
                    • VictorVC
                      VictorVC @SEOExecutive20 last edited by

                      It was just crawled. And it was after robots.txt was uploaded. This is the page it lists: siteUtil.js

                      SEOExecutive20 VictorVC 3 Replies Last reply Reply Quote 0
                      • SEOExecutive20
                        SEOExecutive20 @VictorVC last edited by

                        This is a javascript file and I don't see it being an issue unless Google thinks your hiding it to be spammy .  Also, there are some that say it's a benefit to block js files from the search  for SEO purposes. Here is an example of that situation: http://www.seomofo.com/advanced/do-not-let-google-crawl-javascript.html  I think since this is out of your control and goes by the standard of how Godaddy sets up there sites, then it shouldn't be an issue.

                        1 Reply Last reply Reply Quote 0
                        • VictorVC
                          VictorVC @VictorVC last edited by

                          Oh OK great. Thanks so much for your help. I just got nervous because Google puts up the Severe Health Issue warning everytime I get crawled.

                          1 Reply Last reply Reply Quote 0
                          • SEOExecutive20
                            SEOExecutive20 @VictorVC last edited by

                            Your welcome! I'm also sending the other side of the story not to confuse you but to allow you to make a decision based on both sides:  http://groups.google.com/a/googleproductforums.com/forum/#!category-topic/webmasters/crawling-indexing--ranking/8nyxCtv9RHM

                            1 Reply Last reply Reply Quote 0
                            • VictorVC
                              VictorVC @SEOExecutive20 last edited by

                              Yes thanks. I foolishly renamed my home page and caused a duplicate page. Website tonight will not allow me to do a 301 redirect. I put a canonical tag on the /shakeology. Should this do the trick?

                              1 Reply Last reply Reply Quote 0
                              • VictorVC
                                VictorVC @SEOExecutive20 last edited by

                                Since I can't 301 it, would it be bad to delete the dupe page?

                                SEOExecutive20 VictorVC 4 Replies Last reply Reply Quote 0
                                • SEOExecutive20
                                  SEOExecutive20 @VictorVC last edited by

                                  Personally, that's what I would do is delete it.  Unless, there is a reason you need that page.

                                  1 Reply Last reply Reply Quote 0
                                  • VictorVC
                                    VictorVC @VictorVC last edited by

                                    I really do appreciate all of your help. Here's the issue I'm having with this though... After I renamed the homepage file to add /shakeology.html to it (because I thought it would be beneficial to have a main keyword in the url) Website Tonight only shows me the homepage.com/shakeology.html and not the homepage.com. I'm afraid that if I delete /shakeology.html I will show neither one and in essence, according to Website Tonight just be deleting my homepage. I'm not sure how to properly accomplish what I'm looking to do without screwing myself any further??

                                    1 Reply Last reply Reply Quote 0
                                    • SEOExecutive20
                                      SEOExecutive20 @VictorVC last edited by

                                      I found some great info here that I believe explains it: http://support.godaddy.com/help/2986/organizing-your-website-using-the-organize-site-page

                                      1 Reply Last reply Reply Quote 0
                                      • VictorVC
                                        VictorVC @VictorVC last edited by

                                        Yes I saw that but unfortunately the organize your site page on website tonight only shows the new page. I'm afraid to delete it and lose both.

                                        1 Reply Last reply Reply Quote 0
                                        • Dr-Pete
                                          Dr-Pete last edited by

                                          Sounds like SEO Executive has got you covered on the Godaddy front - just wanted to point out a couple of things:

                                          (1) I'm not seeing a preview for your home-page, and I had trouble connecting to it the first time. It seems to be cahced, so this could be a fluke.

                                          (2) Not sure if this is part of the Godaddy code, but there's a really weird tag on the home-page:

                                          name="canonical tag" content=""/>

                                          That might just be a reference, but it doesn't do anything. If it's supposed to actually be a canonical, then something is broken.

                                          VictorVC 1 Reply Last reply Reply Quote 3
                                          • VictorVC
                                            VictorVC @Dr-Pete last edited by

                                            Unfortunately no. The edit page section of Website Tonight only shows the newer homepage.com/shakeology.html version and not the original homepage.com

                                            I am afraid to delete the homepage.com/shakeology.html in fear that I will be left with neither one.

                                            You probably aren't seeing the preview of the .com/shakeology.html because it is not the indexed homepage. It shows for the homepage.com version. The canonical tag was me trying to redirect search engines from the new (unwanted) homepage to the original because Website tonight won't allow me to 301 it.

                                            Dr-Pete VictorVC 6 Replies Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 1 / 2
                                            • First post
                                              Last post
                                            • How long does it take for Webmaster Tools to index a site?
                                              Giovatto
                                              Giovatto
                                              1
                                              3
                                              747

                                            • Changes to 'links to your site' in WebMaster Tools?
                                              Stramark
                                              Stramark
                                              0
                                              3
                                              277

                                            • Manual Webspam Error. Same Penalty on all sites on Webmaster Tools account.
                                              ndroidgalaxy
                                              ndroidgalaxy
                                              0
                                              7
                                              189

                                            • Can I have an http AND a https site on Google Webmaster tools
                                              evolvingSEO
                                              evolvingSEO
                                              0
                                              5
                                              179

                                            • Site was infected with spam webmaster tools still reporting it
                                              Cyrus-Shepard
                                              Cyrus-Shepard
                                              0
                                              4
                                              210

                                            • Site (Subdomain) Removal from Webmaster Tools
                                              irvingw
                                              irvingw
                                              0
                                              7
                                              2.0k

                                            • Webmaster Tools Links To Your Site
                                              SanketPatel
                                              SanketPatel
                                              0
                                              7
                                              567

                                            • Having some weird crawl issues in Google Webmaster Tools
                                              Dan-Petrovic
                                              Dan-Petrovic
                                              1
                                              2
                                              712

                                            Get started with Moz Pro!

                                            Unlock the power of advanced SEO tools and data-driven insights.

                                            Start my free trial
                                            Products
                                            • Moz Pro
                                            • Moz Local
                                            • Moz API
                                            • Moz Data
                                            • STAT
                                            • Product Updates
                                            Moz Solutions
                                            • SMB Solutions
                                            • Agency Solutions
                                            • Enterprise Solutions
                                            • Digital Marketers
                                            Free SEO Tools
                                            • Domain Authority Checker
                                            • Link Explorer
                                            • Keyword Explorer
                                            • Competitive Research
                                            • Brand Authority Checker
                                            • Local Citation Checker
                                            • MozBar Extension
                                            • MozCast
                                            Resources
                                            • Blog
                                            • SEO Learning Center
                                            • Help Hub
                                            • Beginner's Guide to SEO
                                            • How-to Guides
                                            • Moz Academy
                                            • API Docs
                                            About Moz
                                            • About
                                            • Team
                                            • Careers
                                            • Contact
                                            Why Moz
                                            • Case Studies
                                            • Testimonials
                                            Get Involved
                                            • Become an Affiliate
                                            • MozCon
                                            • Webinars
                                            • Practical Marketer Series
                                            • MozPod
                                            Connect with us

                                            Contact the Help team

                                            Join our newsletter
                                            Moz logo
                                            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                            • Accessibility
                                            • Terms of Use
                                            • Privacy