As Andrew stated the bounce is all about the second interaction not the length of time on the page. You are encouraging that second interaction, but don't get hung up on the bounce rate entirely, I rate user experience over everything else.
Having your images open in a new tab rather than a lightbox of similar takes away the users ability to navigate your site. If you are viewing on a phone for example a new tab is a pain to close. I prefer to be able to hit the back button or a cross in the corner of the screen. If I had to close a new tab every time I think I'd leave the site alone.