Yes, you can overwrite all file just unpacked the file of stable package or you can find the different between RC4 package and stable package with a comparison software (likes meld for linux and winmerge for windows) and overwrite only the different files.
In the upgrading tutorial you can read that there isn't difference in database between RC4 and stable version. If you do this your site will upgrade to stable version. Remember make a backup before.


? 