VisEntities Active member Feb 1, 2025 #1 So I've noticed robots viewing user profiles, what’s weird to me is, why? Out of all the hundreds of members, what’s the point of randomly checking a profile? It just doesn't make sense. Anyone know what's going on? I'm a noob in these things
So I've noticed robots viewing user profiles, what’s weird to me is, why? Out of all the hundreds of members, what’s the point of randomly checking a profile? It just doesn't make sense. Anyone know what's going on? I'm a noob in these things
R rogerl Well-known member Feb 1, 2025 #2 They will view anything they can find on your site unless you specifically disallow it in your robots.txt file You need to add a Disallow: /<forumdirectory>/members/ line to prevent it Upvote 1 Downvote
They will view anything they can find on your site unless you specifically disallow it in your robots.txt file You need to add a Disallow: /<forumdirectory>/members/ line to prevent it
MapleOne Well-known member Feb 1, 2025 #3 One way to limit bots looking at user profiles is to restrict profile views to signed in members. It also encourages visitors to sign up. Upvote 0 Downvote
One way to limit bots looking at user profiles is to restrict profile views to signed in members. It also encourages visitors to sign up.