If you want it to be displayed to specific groups then add this
<xen:if is="{xen:helper ismemberof, $visitor, REPLACE ME WITH GROUP ID}">
< member count code>
</xen:if>
Is there ever going to be a centralized, official documentation resource for things like this some day? I think simple addition would be a great place to start. That particular syntax isn't very obvious.