I just gave this a quick test and it works fine for me.
Do they get any error message or just a blank list of albums?
If you personally go to the list of albums, are the albums listed there actually public? Guests can only see public albums. They cannot see albums that are private, members only, shared or those shared with followers.