The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. On-Page / Site Optimization
    4. On Page Optimization, F on all keywords?

    On Page Optimization, F on all keywords?

    On-Page / Site Optimization
    16 5 187
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Carson-Ward
      Carson-Ward last edited by

      I don't see any reason it wouldn't be pulling the page in. Maybe check on the spelling of the keyword? If you have the right URL and the right keyword, it could be a bug, but hard to say at this point. We might be able to help more with a screenshot.

      stokesautogroup 1 Reply Last reply Reply Quote 0
      • stokesautogroup
        stokesautogroup @Carson-Ward last edited by

        Here you go! I have also attached a screen shot of the page grader which gives me an error no matter what URL I input.

        pkY60ct.png NkQ3wC4.png

        1 Reply Last reply Reply Quote 0
        • BruceA
          BruceA last edited by

          This might be an aside to the main issue, but this is a search phrase.  Do your customers or webusers, actually search for this phrase?

          I haven't drilled into this any more, but would be very interested to know which bit of the keyword they would be searching for.

          Phrases are really hard to get a good score on in my experience

          Bruce

          stokesautogroup 1 Reply Last reply Reply Quote 0
          • Linda-Vassily
            Linda-Vassily last edited by

            When I try that page in the on-page grader, I get "Sorry, but that URL is inaccessible. " If I put that URL into Screaming Frog, I see it is 403 (forbidden). I can see the page when I enter it into a browser, however.

            It seems that something is blocking robot access to this page (although I do not see a robots exclusion)...

            stokesautogroup 1 Reply Last reply Reply Quote 1
            • stokesautogroup
              stokesautogroup @BruceA last edited by

              We receive a lot of traffic queries from our business name, our physical location name along with the make of vehicles our dealership carries, and quite a bit from year/make/mode/location. (2015 Toyota Tundra Hilton Head)

              1 Reply Last reply Reply Quote 0
              • stokesautogroup
                stokesautogroup @Linda-Vassily last edited by

                This is our robots.txt file, everything looks normal. Now that you say that, I do notice in our dashboard we have a high amount of crawl issues. At least 1 on each of our campaigns.

                User-agent: *
                Disallow: /request-more-info/
                Disallow: /test-drive-this-car/
                Disallow: /confirm-availability/
                Disallow: /request-vehicle-quote/
                Disallow: /send-to-mobile/
                Disallow: /email-a-friend/
                Disallow: /gallery/
                Disallow: /eprice/
                Disallow: /print-auto/
                Disallow: /autocheck/
                Disallow: /print-coupons/
                Disallow: /request-video-walkaround/
                Disallow: /get-e-finance/
                Disallow: /condition-report/
                Crawl-delay: 2
                Sitemap: http://www.stokesbrowntoyotahiltonhead.com/resrc/xmlsitemap/xml-sitemaps/
                
                User-agent: MJ12bot
                Disallow: /
                User-agent: 008
                Disallow: /
                User-agent: DTS Agent
                Disallow: /
                User-agent: BLEXBot
                Disallow: /
                User-agent: crawler4j
                Disallow: /
                User-agent: Goodzer
                Disallow: /
                
                1 Reply Last reply Reply Quote 0
                • Andy.Drinkwater
                  Andy.Drinkwater last edited by

                  I get a 403 for every page in the site. Is there something with your host that is blocking crawlers?

                  Edit-- OK , so it isn't something with your host as I tried to crawl another site on the same server, and that works without issue.

                  -Andy

                  Linda-Vassily stokesautogroup 2 Replies Last reply Reply Quote 0
                  • Linda-Vassily
                    Linda-Vassily @Andy.Drinkwater last edited by

                    Even the robots.txt page is 403...

                    Andy.Drinkwater 1 Reply Last reply Reply Quote 0
                    • Andy.Drinkwater
                      Andy.Drinkwater @Linda-Vassily last edited by

                      I suspect this is either a permissions problem in the site structure or an issue in .htaccess, neither which we can see.

                      Aside from some messy code, issues on the cosole log and iframes on the page, I can't see that these would cause the problem because the pages are being cralwed and indexed.

                      -Andy

                      1 Reply Last reply Reply Quote 0
                      • stokesautogroup
                        stokesautogroup @Andy.Drinkwater last edited by

                        We are also receiving these issues as well. Seems like its a hit or miss with the crawling.

                        9T3sDlq.png

                        1 Reply Last reply Reply Quote 0
                        • stokesautogroup
                          stokesautogroup last edited by

                          Any ideas of where we should start to narrow down this issue?

                          Andy.Drinkwater Linda-Vassily 2 Replies Last reply Reply Quote 0
                          • Andy.Drinkwater
                            Andy.Drinkwater @stokesautogroup last edited by

                            I would start with contacting the developers and ask them if they have any clue about it Daniel. Failing that, without having a good root around, it's hard to say at a glance what is going on. There certainly are a lot of more general site issues.

                            -Andy

                            1 Reply Last reply Reply Quote 1
                            • Linda-Vassily
                              Linda-Vassily @stokesautogroup last edited by

                              Have you ever been able to see a non-all F report from Moz? If so, I would see what has changed since then. But yes, your developers should be able to give you the answers you are looking for.

                              stokesautogroup 1 Reply Last reply Reply Quote 0
                              • stokesautogroup
                                stokesautogroup @Linda-Vassily last edited by

                                All F's.

                                Looks like our site devs have fixed the issue. I just ran the page grader and we received an A. I guess we wait until Moz crawls our site again to see our updated info.

                                1 Reply Last reply Reply Quote 0
                                • stokesautogroup
                                  stokesautogroup last edited by

                                  Looks like our host solved the problem. They mentioned they were blocking the rogerbot crawler. Anyone have an idea of how long we have to wait until the page grades and other info updates in our dashboard?

                                  1 Reply Last reply Reply Quote 1
                                  • 1 / 1
                                  • First post
                                    Last post
                                  • Keyword ranking for different page than the page optimized
                                    BigTrailerRentals
                                    BigTrailerRentals
                                    0
                                    3
                                    37

                                  • Should I optimize my home-page or a sub-page for my most important keyword
                                    Jacob_A
                                    Jacob_A
                                    1
                                    7
                                    1.6k

                                  • Should a keyword be optimized on One page only?
                                    Gavo
                                    Gavo
                                    0
                                    8
                                    294

                                  • If I want to rank well on one keyword would it be better to optimize multiple pages on the website for the keyword or should I only optimize one page for that keyword?
                                    SanketPatel
                                    SanketPatel
                                    0
                                    6
                                    407

                                  • Why a page with an On Page A grade has a less good rank than a page with a F grade?
                                    bradkrussell
                                    bradkrussell
                                    0
                                    4
                                    351

                                  • 3 keywords optomize for home page. Should I create page with thoses keywords or leave it like this?
                                    BigBlaze205
                                    BigBlaze205
                                    0
                                    3
                                    675

                                  • One domain with keyword optimized pages or multiple domains
                                    dreadmichael
                                    dreadmichael
                                    0
                                    3
                                    862

                                  • Why home page ranks higher than keyword-optimized page
                                    CPU
                                    CPU
                                    0
                                    3
                                    883

                                  Get started with Moz Pro!

                                  Unlock the power of advanced SEO tools and data-driven insights.

                                  Start my free trial
                                  Products
                                  • Moz Pro
                                  • Moz Local
                                  • Moz API
                                  • Moz Data
                                  • STAT
                                  • Product Updates
                                  Moz Solutions
                                  • SMB Solutions
                                  • Agency Solutions
                                  • Enterprise Solutions
                                  • Digital Marketers
                                  Free SEO Tools
                                  • Domain Authority Checker
                                  • Link Explorer
                                  • Keyword Explorer
                                  • Competitive Research
                                  • Brand Authority Checker
                                  • Local Citation Checker
                                  • MozBar Extension
                                  • MozCast
                                  Resources
                                  • Blog
                                  • SEO Learning Center
                                  • Help Hub
                                  • Beginner's Guide to SEO
                                  • How-to Guides
                                  • Moz Academy
                                  • API Docs
                                  About Moz
                                  • About
                                  • Team
                                  • Careers
                                  • Contact
                                  Why Moz
                                  • Case Studies
                                  • Testimonials
                                  Get Involved
                                  • Become an Affiliate
                                  • MozCon
                                  • Webinars
                                  • Practical Marketer Series
                                  • MozPod
                                  Connect with us

                                  Contact the Help team

                                  Moz logo
                                  © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                                  • Accessibility
                                  • Terms of Use
                                  • Privacy