I just tested it on guest view and realize that it's because I am admin. Sorry, don't know why I didn't try this at first.
Is it possible to remove Albums from the Media gallery page and disable it entirely? I just want to use the category system. I have set my permissions to hide the albums but it still shows. I don't know what other permissions I have to change to affect this. The picture attached is the permissions set for all user groups: