Brian-
No worries man. Even though your site doesn't have the coveted high PR yet, Google is fully aware of what you are doing and what is linked to you. I have seen sites go from PR0 to a PR4 over night just because it happened to be the day they released all the new PRs. Don't stress at all about it. Just keep focusing on good SEO practice. You'll get there before long.