Welcome to the Q&A Forum

We have some other reasons for only one page being crawled at https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages- as well.

I'm seeing very little visible content on your home page. When I do a view source, I see an H2 and paragraph that are display:none. That's probably not helping you at all, and may be hurting you. Do you have any noticed about your site in Google Webmaster Tools?

Hi Calvin,

The best place for an API question is probably over at the API discussion forum at https://seomoz.zendesk.com/categories/6328-seomoz-apis-and-extras, or just sending an email to help@seomoz.org. A few users of the API are here, but those two places are your best options. Thanks!

Are the pages blocked from crawling at all? I've seen that happen when Google can't crawl a page, but knows of it because of a followed link from elsewhere.

We do try to crawl higher-quality sites and show some of the better, more meaningful links to you.

Generally, if you can fix it with code, that tends to be a bit better than the canonical tag, from my understanding. I've emailed Dr. Pete and asked him to contribute to this thread as well, as he's an expert on canonical tags.

Howdy! We've made some performance improvements to Q&A, and things should be much speedier now. If you see anything amiss, please leave a reply here or send a note to help@seomoz.org. Thanks!

Many people aren't in DMOZ, and Google will still alter their meta titles and descriptions to match the search query. Google employees have said that one of the reasons the titles are changed in the SERPs is if they look spammy (not saying that yours are, just stating what they have said).

Felt kinda like this today? http://www.bing.com/videos/watch/video/kitten-loses-battle-against-mirror/1jrpikc1z

Glad you were able to figure it out!

Hi Steve,

How are your GA numbers doing now? Did you figure out what was causing the jump? Have they stayed high, or come back down? If you give us an update, we can try to help troubleshoot this for you a bit more.

Everyone should be noticing the performance improvements by now. Early Wednesday morning we rolled out an update that has helped things considerably. If you find any bugs or odd happenings, please either send an email to help@seomoz.org or chime in on the thread about the update at http://www.seomoz.org/q/q-a-performance-improvements. Thanks so much for your patience!

The zig-zag tears are just showing that they've snipped part of the middle of the page out -- they're showing you stuff that matches your query at the top and bottom of your pages, and removing some of the stuff from the middle that doesn't match your query.

You'll see the same thing in print regarding graphs if something is taken out of the X-axis.

Hi! If you download the CSV of your errors, it will tell you the referring URL.

Google may be pulling information from a table. I've seen it on other sites in Q&A, and they're doing it on my own site too (see attached image). All of the information that they're displaying I have in an actual table on my site, and I've done nothing else other than put it in a table.

7kgUW.gif

We can look at hyperlinking the question, as we'll be doing some more tweaks to the emails.

One of the feature we did add was having the question title in the subject line, so messages about different didn't get lumped together in gmail anymore.

So sorry to hear about the battles going on. I've seen some of those, and they're no fun.

One thing that may be of help: last month Google rolled out new user access to GWT, including a way to let view without changing any settings (Barry Schwartz writes about it at http://www.seroundtable.com/google-webmaster-tools-users-14838.html). Is there a chance IT would let your team have a read-only view if you let them know it was now available?

On the first screenshot, I'm thinking that maybe images aren't loading. I'll make sure that we have links back to the question that are in text and not just images in the future, but not sure exactly when that rollout will be. Thanks for letting us know!

Hi Diane,

There is no one tool that is going to show you 100% of the links to your site. Google Webmaster Tools will show you a fair many, but even they do not show you all of the links that they know about. Still, that is probably the most complete information you will get.

Open Site Explorer is generally updated every month, and does not crawl the entire web, so the links it lists will be more delayed and fewer than what you see in GWT. The advantage that OSE has is that you can see links going to sites that are not your own (where you do not have access to GWT because it's not your site) and SEOmoz adds additional metrics that look at the value of the page the link is on.

Have you received any warnings about your links in Google Webmaster Tools, or are you wanting to know about the links just in general?

Part of the reason you're having a difficult time finding those numbers is that it's usually not worth it for the companies doing the rank checking to go that far. With people not going past the first page or two of results, it's not too much a difference if you're ranking on page 11 or page 16 -- the traffic's just not going to be there either way for that keyword.

No, it's Google has work to do, they admitted it was their fault and something went wrong in their classifier.