The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Link Building
    4. Google isn't crawling my website page

    Google isn't crawling my website page

    Link Building
    10 3 157
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • ksmith88
      ksmith88 last edited by

      I have been trying to get indexed my inner page's title tag but still I cannot see this. It has been almost a week. I have done "Fetch as Google" even though I cannot see this. What can be the reason?

      1 Reply Last reply Reply Quote 0
      • Corbec888
        Corbec888 last edited by

        Hi there,

        I know this may sound super basic, but have you checked to make sure the site is not NOINDEX or disallowed in the robots to stop the crawl bot checking the data on the page?

        Google can take a while to update their results sometimes, I would just hold tight perhaps for a few more days.

        ksmith88 1 Reply Last reply Reply Quote 1
        • ksmith88
          ksmith88 @Corbec888 last edited by

          I am sure you are talking about it:

          name="robots" content="index, follow">

          Have I coded right? Rookie in this business

          paupastorlopez 1 Reply Last reply Reply Quote 0
          • paupastorlopez
            paupastorlopez @ksmith88 last edited by

            Hi Kate,

            that code is right, you should also look at your domain.com/robots.txt page to see if you are disallowing.

            You should see something like this:

            User-agent: *
            Disallow: /wp-admin/
            

            This is correct. But if you see a "Disallow: /" that means that is disallowing all the website, and if you see a Disallow: your inner page...

            In any case, I recommend you tu create a link in a website of the topic of your web to this page, maybe in a forum or a directory, to let Google index faster your page.

            Hope you resolve this!

            ksmith88 1 Reply Last reply Reply Quote 1
            • ksmith88
              ksmith88 @paupastorlopez last edited by

              This is the actual page you are referring to: https://www.paydaysunny.com/robots.txt

              Seems OK to me. I should wait for few days.

              1 Reply Last reply Reply Quote 0
              • paupastorlopez
                paupastorlopez last edited by

                Yes, it's ok. Probably the inner page will get indexed just waiting a few days.

                But you can tell us which is the inner page to look if all is correct.

                ksmith88 1 Reply Last reply Reply Quote 0
                • ksmith88
                  ksmith88 @paupastorlopez last edited by

                  This is the page that has not been indexed yet in Google.

                  https://bit.ly/2Hqr1Gp

                  By the way, sorry for digressing. Here is my competitors link.

                  http://yingxiangzhi.com/news/index.php?id=/no-fax-payday

                  Can you please let me know what sort of this link is and how can I build it?

                  thank you

                  paupastorlopez 1 Reply Last reply Reply Quote 0
                  • paupastorlopez
                    paupastorlopez @ksmith88 last edited by

                    That page is indexed in Google:

                    https://www.google.com/search?q=site:paydaysunny.com/payday-loans.html&rlz=1C1CHBD_esES777ES777&gbv=2&sei=mgkYW7KmB4PcwQKO956oBg

                    And the link seems to be from a PBN (Private Blog Network).

                    You won't be able to create a link on that site, you'll have to look for another ones... Or create your own PBN or buy a link to someone that has a PBN.

                    ksmith88 1 Reply Last reply Reply Quote 1
                    • ksmith88
                      ksmith88 @paupastorlopez last edited by

                      Yes, the page is indexed but I had changed the title tag, it is still showing old one.

                      What is the fastest way to index website in Google?

                      Private Blog Network? is it useful to rankings?

                      1 Reply Last reply Reply Quote 0
                      • paupastorlopez
                        paupastorlopez last edited by

                        Just at the right of the url you can see the cache version from Google of this page. By clicking to the "arrow" than points down.

                        You can see that the Snapshot is from 28-05-2018: http://webcache.googleusercontent.com/search?q=cache:Pu-yOVqMlVAJ:www.paydaysunny.com/payday-loans.html+&cd=1&hl=en&ct=clnk&gl=en

                        Surely the spider-bot will crawl the page soon again and it will show the new title, be patient and don't force this 😉

                        Googlebot takes more or less time to reindex if your site is more or less active.

                        The other questions:

                        1. The fastest and better way to index a website in Google is to create links in a very active website of your topic.
                        2. Almost every PBN was very useful 2-3 years ago, today you have to create a very natural and quality PBN to cheat Google with links like this. It takes a lot of work / money, so I don't recommend you this tecnique.
                        1 Reply Last reply Reply Quote 1
                        • 1 / 1
                        • First post
                          Last post
                        • HELP! Google is penalizing me and I can't figure out why.
                          MattAntonino
                          MattAntonino
                          1
                          6
                          129

                        • What is the importance of root domains linking to your website in Google's rankings? I notice our competition has a much higher number on keywords I'm analyzing. Thank you!
                          mjfinet
                          mjfinet
                          0
                          3
                          100

                        • Blog's Homepage isn't indexed even though posts are
                          irvingw
                          irvingw
                          0
                          3
                          261

                        • My Yahoo Directory listing isn't being indexed by Google - what do to?
                          dusanb
                          dusanb
                          0
                          4
                          567

                        • How often does Google crawls old pages, is it worth to get links from them ?
                          RobertFisher
                          RobertFisher
                          0
                          4
                          681

                        • 301 to main page or deeper page for best 'link juice'.
                          lavellester
                          lavellester
                          0
                          2
                          452

                        • Is it ever the case that a link isn't worth having?
                          Benj25
                          Benj25
                          0
                          7
                          956

                        • I'm building backlinks to a certain page on my website, optimizing for 2 keywords. Since I'm spending a lot of time building backlinks to this page should I also do heavy internal linking with the keywords that point to this certain page as well?
                          C-Style
                          C-Style
                          0
                          4
                          841

                        Get started with Moz Pro!

                        Unlock the power of advanced SEO tools and data-driven insights.

                        Start my free trial
                        Products
                        • Moz Pro
                        • Moz Local
                        • Moz API
                        • Moz Data
                        • STAT
                        • Product Updates
                        Moz Solutions
                        • SMB Solutions
                        • Agency Solutions
                        • Enterprise Solutions
                        • Digital Marketers
                        Free SEO Tools
                        • Domain Authority Checker
                        • Link Explorer
                        • Keyword Explorer
                        • Competitive Research
                        • Brand Authority Checker
                        • Local Citation Checker
                        • MozBar Extension
                        • MozCast
                        Resources
                        • Blog
                        • SEO Learning Center
                        • Help Hub
                        • Beginner's Guide to SEO
                        • How-to Guides
                        • Moz Academy
                        • API Docs
                        About Moz
                        • About
                        • Team
                        • Careers
                        • Contact
                        Why Moz
                        • Case Studies
                        • Testimonials
                        Get Involved
                        • Become an Affiliate
                        • MozCon
                        • Webinars
                        • Practical Marketer Series
                        • MozPod
                        Connect with us

                        Contact the Help team

                        Join our newsletter
                        Moz logo
                        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                        • Accessibility
                        • Terms of Use
                        • Privacy