Yeah you have it right; you can just power it down and delete the computer object from AD. Not sure if you have scavenging turned on in DNS but if you don't you can also delete records for this box in DNS.
Thanks
Mike