You can edit the appropriate templates to wrap the code in a conditional.
<xen:if is="{$visitor.is_admin} or {$visitor.is_moderator}">
This content will display to Administrators and Moderators only.
</xen:if>
You would have to do it for the member card and profile page.