It's just as possible with closed source IRCds. Maybe harder to do at the IRCd software itself (maybe) but there are plenty of other layers where server admins can monitor traffic if they really want to.
Like you said, encryption is the only way that's going to allow truly secure communication. Unfortunately IRC doesn't provide the necessary encryption options.