The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Intermediate & Advanced SEO
    4. Max Amout Of HTML Pages In A Folder

    Max Amout Of HTML Pages In A Folder

    Intermediate & Advanced SEO
    5 4 94
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • alrockn
      alrockn last edited by

      What's the maximum amount of html pages that one should put in a folder, to get the best SEO GoggleBot crawl?  I'm aware that there's a limit of 10,000 on most servers, but was curious to know if a lesser amount of pages would be better, for crawling and indexing purposes.  Also curious on peoples opinions on whether .jpg and .gif files should follow similiar rules.

      1 Reply Last reply Reply Quote 0
      • Ray-pp
        Ray-pp last edited by

        AFAIK there is no efficient # of files to include in a folder directory for maximum crawl effectiveness. If you folder legitimately warrants 5k html pages in a directory, then Google will crawl all the pages. Make sure to create value-added pages with high quality content - Google will recognize them and crawl them as appropriate.

        If you have the options, use your Google Webmaster Tools account to adjust crawl settings. Once your site is a specific size, Google will take-over crawl rate settings for you.

        1 Reply Last reply Reply Quote 0
        • Andy.Drinkwater
          Andy.Drinkwater last edited by

          Hi,

          As Ray-pp said, there isn't an optimal number of pages that are going to serve you better.

          However, if you want to help Google discover more about your site and pages of importances, look to create a good internal linking strategy. This doesn't mean that you should just add footer or sidebar links though - these are context links that talk about a different subject, along with a link to the appropriate page.

          If you get this right, you can gain a lot in terms of Google understanding more about what you have to offer, and the links to primary pages can also lead to an increase in the SERPs for various phrases.

          -Andy

          1 Reply Last reply Reply Quote 0
          • EricaMcGillivray
            EricaMcGillivray last edited by

            For images, you want to make sure they're optimized for the web: small file sizes for easy download, but still a resolution that shows the image clearly. Your graphic designer and a good graphic design program (Photoshop, Gimp, etc.) should help with this.

            1 Reply Last reply Reply Quote 0
            • alrockn
              alrockn last edited by

              Thanks for all the input.  Google does seem to crawl everything these days, so I'm also in conclusion if the files fit, they'll get crawled.  Sitemaps, internal links and optimized images are all a must.

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              • First post
                Last post
              • Multiple h1 tags on this html 5 page a issue?
                bridhard8
                bridhard8
                0
                3
                153

              • Links / Top Pages by Page Authority ==> pages shouldnt be there
                Neckermann
                Neckermann
                0
                5
                120

              • How to 301 Redirect /page.php to /page, after a RewriteRule has already made /page.php accessible by /page (Getting errors)
                DirkC
                DirkC
                0
                2
                435

              • Page in html and Wp as blog
                ThompsonPaul
                ThompsonPaul
                0
                4
                95

              • HTML NAP Matching Place Page NAP
                sublimeliam
                sublimeliam
                1
                6
                3.8k

              • 301 redirect Actinic HTML pages to ASP. Achievable?
                MagicDude4Eva
                MagicDude4Eva
                0
                2
                399

              • Do in page links pointing to the parent page make the page more relevant for that term?
                IM_Learner
                IM_Learner
                0
                6
                747

              • Keeping the Navigation on the Sitemap HTML Page?
                AlanBleiweiss
                AlanBleiweiss
                0
                4
                1.5k

              Get started with Moz Pro!

              Unlock the power of advanced SEO tools and data-driven insights.

              Start my free trial
              Products
              • Moz Pro
              • Moz Local
              • Moz API
              • Moz Data
              • STAT
              • Product Updates
              Moz Solutions
              • SMB Solutions
              • Agency Solutions
              • Enterprise Solutions
              • Digital Marketers
              Free SEO Tools
              • Domain Authority Checker
              • Link Explorer
              • Keyword Explorer
              • Competitive Research
              • Brand Authority Checker
              • Local Citation Checker
              • MozBar Extension
              • MozCast
              Resources
              • Blog
              • SEO Learning Center
              • Help Hub
              • Beginner's Guide to SEO
              • How-to Guides
              • Moz Academy
              • API Docs
              About Moz
              • About
              • Team
              • Careers
              • Contact
              Why Moz
              • Case Studies
              • Testimonials
              Get Involved
              • Become an Affiliate
              • MozCon
              • Webinars
              • Practical Marketer Series
              • MozPod
              Connect with us

              Contact the Help team

              Join our newsletter
              Moz logo
              © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
              • Accessibility
              • Terms of Use
              • Privacy