Welcome to the Q&A Forum

For indexing, you can do a site: in the search engine to see what's been indexed. To look at a specific page, in addition to the site: operator, add inurl: and some words from the URL to help narrow down the results. For caching, I use the Resurrect Pages extension for Firefox. Right click while you're in the page, and you can select one of several caching sites to see if that page is available. It's also handy for when you're getting a 404 on a page and want to see what was there. According to the plugin page, you can use the following caching sites: Searches through five big page cache/mirrors: CoralCDN Google Cache Yahoo! Cache The Internet Archive MSN Cache Gigablast WebCite The extension is available at https://addons.mozilla.org/en-us/firefox/addon/resurrect-pages/

Honestly no.. and noone seems to know the answer (I ofcause havent tried to ask google). I have tried everyone from Search Engine Land, SEOmoz, webmaster forums, googles webmaster forums, other experts within the industry.. and noone seems to have any idea or have ever experienced it for that matter. What I wound up doing was: 1. make a new landing page for the subject and did a ton of link building paying close mind to the anvhor texts as always. 2. make a 301 redirect to the new page. After some months the problem stopped.. I have however never found the reason for the problem. And no one seems to know the answer

you made a good point, so many of my clients keep bringing up budget but if they dont want to invest theirs not much point having an old social media setup, Thank you

If it has come back and lost it's rankings again, there is definitely something happening that Google ddoesnt like. This will be anything that they might consider black hat, so check their webmaster guidelines, but my guess would be back links still. You have to remember that you are already in a grey are with the subject matter of the site, as many are unethical and will employ unethical techniques. If you are linked to any of these, you could also be getting penalised. Regards, Andy

Thanks for the tips Lewis it's much appreciated.  I will be keeping a close eye on this and hopefully it will clear up.  If you are interested here is a link to one of the hacked sites containing our link that is still active  http://johnwakefield.co.uk/ifapj/ebods.php?ti=130037 All the bad links I have found seem to be in this format domain.com/something/something.php?=number So i assume they were all made by the same person.  Again thanks for the tips.

Okay take this with a pinch of salt because this is quite old information and things do change quickly in this business. Yahoo used to value pages over domains, so if you had the 'best' page on a subject that is what would count, the information on the domain itself was largely irrelevant, and this may still be the case. Google has a more holistic approach, considering the domain as a whole. This may be what is causing the difference. As Andy says they all have their own algorithms and ways of judging a site, and this is just a symptom of that. It's not really a reason to worry though Google is still the largest player (certainly in the West and especially the EU) and exposure on there will likely help push your rankings on the other search engines up as well over time. Lets face it, if you're doing well in Google you're ahead of the game, you've done well. For the time being just keep doing what you're doing.

Yes! Look at how items can be sorted (i.e. by price, etc... so people can see the cheapest items first). Then think how the products you're feeding in might be sorted by your target audience and adjust accordingly so your stuff comes up first in the sorted results

Can you post a screenshot of one of the pages or a link to it please? Regards, Andy

Can you explain to me how you did your site map for this please?

Thanks!

related to this, has there been any research done to see which urls convert better (lower case, upper case, camel case), etc?

There is a whole Learn SEO section at SEO Moz and I would also recommend becoming aware of Google's SEO advice at:- http://www.google.com/support/webmasters/bin/answer.py?answer=35769 and a PDF guide http://www.google.com/webmasters/docs/search-engine-optimization-starter-guide.pdf Hope this helps!

Hi! I'm following up on older, unanswered questions. Can you tell us what you ended up doing in this case, and any lessons you learned that could be helpful to others reading this thread? Thanks!

All juice goes to first link unless you # the link.

I know this is an insanely old question, but as I was looking it up as well and stumbled on this page I thought I would provide some updated info in case anyone else is looking. The user agent can't be found on the page that is listed anymore. However it is on https://moz.com/help/guides/moz-procedures/what-is-rogerbot Here is how our server reported Rogerbot in its access logs (taken from May 2013). Notice that there is a difference with the crawler-[number] rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot, rogerbot-crawler+pr1-crawler-02@seomoz.org rogerbot/1.0 (http://www.seomoz.org/dp/rogerbot, rogerbot-crawler+pr1-crawler-16@seomoz.org) [updated link added by admin]