How much content does Google Crawl on your site?

[mdorville]

Hi,

We've had a debate around the office where some people believe that Google only crawls the first 150-200 words on a page and some people believe that they priority content that is above the fold and other people believe that all content has the same priority. Can you help us?

Thanks,
Matt

[matbennett]

They definitely crawl more than that, and it's easy to prove as well.

Pick a long page, such as the Wikipedia page about London. Choose a block of text from near the bottom of that page, I've selected this:

in the south-western suburb of Wimbledon.[252] Other key events are the annual mass-participation London Marathon which sees some 35,000 runners

If you search for that text you will see the Wikipedia page in the results.  If they only crawled the first 200 words they wouldn't have been able to find that result.

Prioritising is harder to demonstrate (and probably also to define!). However it is generally believe that greater importance is given to text towards the top of the page.  That is logical if you consider how the majority of documents are structured.

[NatanValencia]

Google actually crawls 150kb, excluding css files, images, etc.

150kb is much more than 200 words, and the experiment suggested by Mr Bennett proves it.