At the very top of your user group permission (this needs to be done, per user group) make sure this is checked, allow.
View user profiles >
ALLOW
Once done there, scroll down until you find this.
View attachment 29225
This is how I have mine setup.
Unless you're using a modification outside the default XenForo.... This should work.