Nope. Just remember that any vms stored on the local storage will be deleted. I believe that will include any templates you have created.
As far as the pool goes if you just move any data you need off the server to others in the pool and then remove the server from the pool you should be good to go. Just be sure to remove the server from the pool. Don't just power it off and yank it.