Hi Maldinii
This could potentially be harming, though mainly because you say the only links are from bad sites with poor anchor text. If the website also had a reasonable number of good links, then it wouldn't matter, probably.
This is because Google in particular simply discount irrelevant links from poor websites/websites in a bad neighbourhood rather than penalise a site for having those kind of links. Except for when it's apparent that those links have been purchased as a part of a link building scheme to try and artificially inflate rankings, when both link provider and link receiver are at risk from a penalty.
For some reassurance, have a read of this blog post entitled "What if My Competitors Point Spammy Links to My Site?" and in particular, the section "Defending Yourself from Potential Link Attacks".
Also, view the whole of this video from Rand entitled "I'm Being Outranked by a Spammer" which has some relevant information for you around what I've described here, which is poor spammy links being discounted by Google, so no harm will likely be done purely from having these links. Still need to have some good links coing in though otherwise the overall SEO will be poor and indeed, you probably won't rank highly.
There isn't much that can be done about those unwanted links pointing in, which is a reason why it won't usually attract a penalty purely for having those links.
What you can do is to start some ethical link building, create some great valuable unique content and distribute it well to start attracting some of the right kind of links from relevant authoritive websites.
I hope that helps
Regards
Simon
