Welcome to the Q&A Forum

The rel canonical tag shouldn't remove the duplicate versions from the index. It would suggest to Google which version is the main version. If you want to remove the duplicate version from the index, maybe you could add a meta robots no index, follow tag. http://www.seomoz.org/learn-seo/duplicate-content