You can Install RIS onto another machine but you would need to rebuild/replace your images, you can rebuld the machine then copy the files from your existing disk to the new server as a straight copy and replace.
To continue using RIS you will have to keep using server 2003, as 2008 is only WDS now and iirc there is no compatability mode as there was with 2003R2.