There is no such single library for this work. There are a lot of RAW-definitions out in the world since most camera-brands have their own format.
You could take a look at dcraw (http://www.cybercom.net/~dcoffin/dcraw/) and see what you can do with that.