Manual:$wgImplicitGroups

Details
is an array of groups that are not shown in Special:Listusers and on a few other places. Note that they cannot be assigned through Special:Userrights.

Note
It would hide only group names in the menu, not the users themselves.