You can get rid of most annoyance if you do as explained here (this will turn if off if you follow both steps)
http://www.howtogeek.com/howto/19495/stop-office-2010-upload-center-icon-from-displaying-in-the-taskbar/ but I have not found how you can actually uninstall or remove it except by removing Office 2010.