Welcome to the Q&A Forum

I still think you should just shed the optimization for the homepage and optimize another url for that  keyword (let the homepage be un optimized or optimize it for something else).   I'm assuming that it's the current optimized URL (in this case, http://xxxxx.com)  that's taking the hit from google. The overall authority for the domain may still be strong, so optimize a different URL for your keyword and see what happens.