So you removed a bunch of sitewide (anchor-text rich ? ) links and you recovered. That's pretty much how everybody understands it.
And yes, there was a Penguin refresh on October 5th. More credibility to the notion that you can only recover from Penguin during a refresh or update. And If you recovered at any other time, then you probably weren't hit by Penguin in the first place.