Manual action and no ranking impact?

[EndeR-]

Hello,

I received the message in Google Webmasters Tools about unnatural links to site (https://www.youtube.com/watch?v=6UFHCw4Q_FQ) for two of my websites. I have a hard time undestanding why since I don't buy links, I don't do link exchanges and I don't directories or article directories.

Anyways, I received this message on Friday and I didn't lose any rankings on either of those sites or at least not on my main keyword which is the only one that matters.

Is it normal that I didn't lose any rankings?

Would you advise I do anything specific?

Thanks a lot.

[EndeR-]

Another thing:

When I click to read the message in webmaster's tools, I get a message saying that I used link spam and I get this video:

https://www.youtube.com/watch?v=6UFHCw4Q_FQ

As an illustration of my situation.

Now when I go to the search traffic tab and click on manual action, it tells me that some of my links are suspicious and that they may have been made by someone else than me. Because of that the manual action will be to stop taking those links into account. The video I get as an illustration is that one:

https://www.youtube.com/watch?v=7Y74Op_k6UY

Which is a lot less alarming.

Also it says:

Impact on the whole site: none

Impact on a part of the website: yes. And then they give me reasons for it.

So my question is: should I expect to lose rankings because it's the first video that applies to my case, or should I expect some links to not being taken into account anymore because it's the second video that applies to me?

Thanks.