Site categories are ones created by admins in the ACP. Albums are created by individual users. A user can add as many media items as they wish to either with the necessary permissions.
On my site I use site categories to match forum categories which in turn relate to video game types. Albums tend to be used more for personal things. That's just how it works for my community, you can use them however it suits you.