Welcome to the Q&A Forum

It's hard to say what to do without knowing the size of your site's backlink profile, but here is my best shot given the information you've provided. If you are currently ranking #2, I would not get rid of any backlinks at the moment, unless they are 100% against Google's TOS (paid, hidden, etc). However, I would also be really focused on acquiring more relevant and natural links to make sure your overall backlink profile looks solid and should survive future algorithms/inspections. As your backlink profile gets stronger, consider removing poor backlinks gradually for increased SERP stability. Don't worry about Moztrust. It's just a metric, and not one used by Google.