Add-ons should extend the core files, not modify them.
Uninstalling an add-on should remove it cleanly, depending on the add-on and how it has been coded.
If in doubt, take a backup of your database.
The core server files can be re-uploaded at any time using the upgrade .zip package.