I don't think setting super administrators in the configuration file works in XF2+.
I just tested and while you can't remove your own administrator record, you can delete your own account, even if you are the only administrator. This is almost certainly a bug. I'm not sure if it's possible to fix this situation without direct queries.