Welcome to the Q&A Forum

This concerns f5.com, a large website with navigation menus that drop down when hovered over. The sub nav items (example: “DDoS Protection”) are not cached by Google and therefore do not distribute internal links properly to help those sub-pages rank well.

Best option naturally is to change the nav menus from JS to CSS but barring that, is there another option? Will Schema SiteNavigationElement work as an alternate?

Just wrote a post exploring the various indexation checking options. Settled on URL Profiler as best solution for Enterprise-sized sites.
http://seattlesearchnetwork.org/seo-tools/check-enterprise-website-google-cache-status/

Neither Apple nor Google straight-out give you keyword data in their consoles. However, there are a few workarounds.

Apple has recently added "Apple Analytics" that give useful data, including device types and referring sites. They likely may add KW data in future.

GP (Google Play) does not report keyword data in the Developers Console but (surprise!) when connected to one's GSC (formerly known as WMT), all sorts of juicy data (including keywords) is viewable in GSC. 
http://googlewebmastercentral.blogspot.com/2015/05/rolling-out-red-carpet-for-app-owners.html

App Annie is very useful for competitive research. It's the best tool out there, followed from a distance by Sensor Tower, App Figures and others. But the best guestimate for volume they offer is "Results" for an app store search, which just means how many apps show up for it. Sensor Tower has a guestimate volume based on the AdWords KW tool.

The URL Keri posts has a lot of helpful info, but does not answer Luke's original question. I am very curious about such a tool as well.

Here is my research on the subject:

There are numerous sites offering to check 20-50 URLs for index status. (Search for "bulk indexation checker") but none available to check the thousands of pages on a typical enterprise site.

Why not just trust WMT for the list? A) Large complex sites have too many pages excluded via robots or non-index tags. Important pages can slip through the cracks. More importantly, B) I do not trust WMT data.

Why not just use Screaming Frog, IIS, SEOtools for Excel, Xenu or another site scraper, to check if a cached copy exists? Seems simple, just plug in a list of URLs like http://webcache.googleusercontent.com/search?q=cac... and report which throw 404 errors. Unfortunately, Google dislikes this and forces CAPTCHAs after 30 or so.

After much research, I have only uncovered two ways to check large #s of URLs: 1) Scrapebox, with rotating proxies
2) Using the Moz toolbar and this search https://www.google.com/search?q=site:www.zappos.co... Export the SERP to CSV using the Mozbar then do it over again to the next 200: https://www.google.com/search?q=site:www.zappos.co... Merge & purge.

The idea would be to use either method to generate a list, then check it against a site crawl/sitemap file to see if all important pages are indexed.

QUESTION: Does anyone know of a better method than 1 or 2 above? I'd be happy to share the results of my research with anyone similarly interested.

Thanks,

Carl

This post from Distilled mentions that SEO for Excel plugin has a "Indexation Checker":
https://www.distilled.net/blog/seo/awesome-examples-of-how-to-use-seotools-for-excel/

Alas, after downloading and installing, it appears this feature was removed...

Unfortunately none of these tools give accurate info. I know because I compared against my own campaigns. Had a SPyfu paid acct for years and it is a useful tool, but not for quantifying adspend.

This was kind of helpful:
http://searchengineland.com/tips-for-spying-on-your-ppc-competitors-89988

Any other advice out there?

Does anyone have an idea on how Google ranks or determines the 'Points of Interests' that come up when searching about places/cities?

I'd be very interested to hear anyone else's suggested replacement for this tool as well. SEOmoz's whittling  down their toolset, and the relative uselessness of the CLF means that I have had to buy SEO Powersuite and Raven to try to find alternative tools. Now to find the time to actually use them, that's a whole 'nother problem....

Hi Theresa.

There's an easy way to remove personalized search results. Just add &pws=0 to the end of the search url.

More info:

http://seattleseonetwork.org/2011/accurate-rank-checking/

Thread bump!