In Linux, you will get an error if you cannot access the file. For the OS you should be fine doing live backup, some applications using database like mysql require special backup procedures.
In Windows, you normally use the System State option to backup the live OS files using Microsoft VSS (Volume Shadow Services) which keeps a current snapshot of open files.