ACP >Options > User Options
Untick "Allow Banner Stacking"
Make sure that the other user groups have a higher styling priority (set in the group settings). When users are added to these other groups, only the banner from the group with the highest styling priority will be shown.