The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Website Crawl problems

    Website Crawl problems

    Intermediate & Advanced SEO
    3 3 442
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Alexey_mindvalley
      Alexey_mindvalley last edited by

      I have a feeling that Google doesn't crawl my website.

      E.g. this blogpost  - I copy a sentence from it and paste it to Google. The page that shows up in search results is www.silvamethodlife.com/page/9/  - which is just a blog page with all the articles listed, not the link to the article itself!

      Did anyone ever have this problem? It's definitely some technical issue.

      Any advice will be deeply appreciated

      Thanks

      1 Reply Last reply Reply Quote 0
      • tam_pearseconsulting.com
        tam_pearseconsulting.com last edited by

        I noticed that your category pages specify noindex,follow and index,follow.  Might want to make a decision there.

        Google has indexed 676 pages of the 817 on your site and, since their are quite a few URLs that specify nofollow correctly without the additional index like mentioned above, I'd say that is about right.

        Did not see the issue you spoke of when I checked some random sentences.

        Wouldn't be concerned unless you notice this is coupled with a decrease in organic traffic.  If so start looking at off page factors.

        1 Reply Last reply Reply Quote 0
        • MoosaHemani
          MoosaHemani last edited by

          When i use the same tactic as you defined in your question’s explanation i was able to see your page in the search results...

          Use this common in search bar to see how many pages are indexed in Google ‘site:example.com’.

          May be not all the pages are indexed, for that try and check the following two things:

          • Make sure all pages of the website are follow,index for Google and other search engines
          • Update your sitemap and submit it to Google webmaster tool and you will see the efficiency in website page index.

          Hope this helps!

          1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post
          • My Website Lost All Rankings Due To Canonical Problems
            yigitgok
            yigitgok
            0
            7
            151

          • Why is Amazon crawling my website? Is this hurting us?
            oxidants
            oxidants
            0
            4
            677

          • Website Indexing Issues - Search Bots will only crawl Homepage of Website, Help!
            LoganRay
            LoganRay
            0
            2
            278

          • Any problem with 4 websites
            TakeshiYoung
            TakeshiYoung
            0
            5
            139

          • Urgent problem - multilingual website title tag and meta description problem
            serp-eesti
            serp-eesti
            0
            7
            2.5k

          • Problem with SEO for my Image based website.
            AlanMosley
            AlanMosley
            0
            4
            426

          • If other websites implement our RSS feed sidewide on there website, can that hurt our own website?
            rhondahurwitz
            rhondahurwitz
            0
            9
            290

          • Website up for 3 months still not crawl
            David_ODonnell
            David_ODonnell
            0
            3
            361

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy