There is actually a mode that will make it so that the nicklist is only visible by the operators.

From the help for the server I'm on...

*** UnrealIRCd Channel Modes ***
-
u = "Auditorium". Makes /NAMES and /WHO #channel only show Operators.

- Jason