The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Behavior & Demographics
    4. Only 11 pages being crawled

    Only 11 pages being crawled

    Behavior & Demographics
    4 4 129
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Chris__Chris
      Chris__Chris last edited by

      Hi,

      Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??

      http://www.lifetimelegal.co.uk

      Kind Regards

      Elissa

      1 Reply Last reply Reply Quote 0
      • Martijn_Scheijbeler
        Martijn_Scheijbeler last edited by

        Hi Elisa,

        It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.

        Hope this helps!

        1 Reply Last reply Reply Quote 1
        • SEOAndy
          SEOAndy last edited by

          Just looking around your site, the code seems ok - to a large extent.

          But you are missing a sitemap (handy to point to all urls) and a robots.txt file

          Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?

          1 Reply Last reply Reply Quote 1
          • MoosaHemani
            MoosaHemani last edited by

            When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow

            • Strong Internal Linking

            It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages

            • Xml Sitemap

            The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle

            Hope this will help!

            1 Reply Last reply Reply Quote 1
            • 1 / 1
            • First post
              Last post
            • Long list or paginated pages
              Andy.Drinkwater
              Andy.Drinkwater
              2
              8
              104

            • Location Pages
              DonnaDuncan
              DonnaDuncan
              0
              2
              48

            • Blocking links from being crawled
              evolvingSEO
              evolvingSEO
              0
              16
              270

            • Looking for something better than Googles in page analytics
              ThompsonPaul
              ThompsonPaul
              1
              4
              170

            • My e-commerce site is getting great results with customer search for our store name, but we are still on page three or four in google when search for product key words. How can I get us on the first page when searching with product titles?
              bradkrussell
              bradkrussell
              0
              6
              275

            • Irratic page rank results - why?
              matbennett
              matbennett
              0
              2
              253

            • Is a Shorter Page Title Better?
              RuthBurrReedy
              RuthBurrReedy
              0
              7
              859

            • How to get more page impressions?
              SallyO
              SallyO
              0
              13
              4.8k

            Get started with Moz Pro!

            Unlock the power of advanced SEO tools and data-driven insights.

            Start my free trial
            Products
            • Moz Pro
            • Moz Local
            • Moz API
            • Moz Data
            • STAT
            • Product Updates
            Moz Solutions
            • SMB Solutions
            • Agency Solutions
            • Enterprise Solutions
            • Digital Marketers
            Free SEO Tools
            • Domain Authority Checker
            • Link Explorer
            • Keyword Explorer
            • Competitive Research
            • Brand Authority Checker
            • Local Citation Checker
            • MozBar Extension
            • MozCast
            Resources
            • Blog
            • SEO Learning Center
            • Help Hub
            • Beginner's Guide to SEO
            • How-to Guides
            • Moz Academy
            • API Docs
            About Moz
            • About
            • Team
            • Careers
            • Contact
            Why Moz
            • Case Studies
            • Testimonials
            Get Involved
            • Become an Affiliate
            • MozCon
            • Webinars
            • Practical Marketer Series
            • MozPod
            Connect with us

            Contact the Help team

            Join our newsletter
            Moz logo
            © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
            • Accessibility
            • Terms of Use
            • Privacy