I would like to upgrade from 1.3 to 1.4 version, but I have some of add in (see the list) - I am not sure what problems once upgrade into 1.4 version - Can you help me?
Just to mention: in general, no, though there's no harm.
Beyond that, as mentioned, you would need to check with the add-on authors for any recommendations. (Though people haven't had issues removing the sitemap add-on after upgrading, as far as I know.)