The Moz Q&A Forum

    • Forum
    • Questions
    • My Q&A
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Q&A Forum
    2. Categories
    3. Technical SEO Issues
    4. How far into a page will a spider crawl to look for text?

    How far into a page will a spider crawl to look for text?

    Technical SEO Issues
    2 2 630
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • crvw
      crvw last edited by

      How far into a page will a spider crawl to look for text? I've heard a spider will only crawl the first 3kb, but can't find an authoritative source for that information.

      1 Reply Last reply Reply Quote 0
      • Theo-NL
        Theo-NL last edited by

        Far, far more than 3kb. Somewhere halfway this blog (http://www.finishjoomla.com/blog/41/does-source-code-ordering-still-matter-for-seo/) you'll find some references to sources on this same issue, they might be helpful for you.

        1 Reply Last reply Reply Quote 1
        • 1 / 1
        • First post
          Last post
        • Very wierd pages. 2900 403 errors in page crawl for a site that only has 140 pages.
          H.M.N.
          H.M.N.
          0
          6
          64

        • Site Crawl -> Duplicate Page Content -> Same pages showing up with duplicates that are not
          davebuts
          davebuts
          0
          2
          72

        • Inner pages will not rank - only Home Page
          David-Kley
          David-Kley
          0
          4
          202

        • Will Google index a site with white text? Will it give it bad ratings?
          CloudGuys
          CloudGuys
          0
          3
          457

        • Page crawling is only seeing a portion of the pages. Any Advice?
          KeriMorgret
          KeriMorgret
          0
          5
          371

        • What is the largest page size a searchbot will crawl?
          JamesNorquay
          JamesNorquay
          0
          2
          1.1k

        • Crawl report showing only 1 crawled page
          Mikpam
          Mikpam
          0
          4
          913

        Get started with Moz Pro!

        Unlock the power of advanced SEO tools and data-driven insights.

        Start my free trial
        Products
        • Moz Pro
        • Moz Local
        • Moz API
        • Moz Data
        • STAT
        • Product Updates
        Moz Solutions
        • SMB Solutions
        • Agency Solutions
        • Enterprise Solutions
        • Digital Marketers
        Free SEO Tools
        • Domain Authority Checker
        • Link Explorer
        • Keyword Explorer
        • Competitive Research
        • Brand Authority Checker
        • Local Citation Checker
        • MozBar Extension
        • MozCast
        Resources
        • Blog
        • SEO Learning Center
        • Help Hub
        • Beginner's Guide to SEO
        • How-to Guides
        • Moz Academy
        • API Docs
        About Moz
        • About
        • Team
        • Careers
        • Contact
        Why Moz
        • Case Studies
        • Testimonials
        Get Involved
        • Become an Affiliate
        • MozCon
        • Webinars
        • Practical Marketer Series
        • MozPod
        Connect with us

        Contact the Help team

        Join our newsletter
        Moz logo
        © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
        • Accessibility
        • Terms of Use
        • Privacy