I preferr to not use plugins and rather hardcode everything into the theme, it may dramatically improve your website speed. Altough it does depend on your HTML/PHP/CSS skills.
I do however use the following on some of my websites:
Analytics 360 - Great when connected to Google Analytics, you no longer have to go there for the basic data.
All in one SEO - Fairly common used plugin, there may be better ones but i does offer some good customization.