A lot of people on IRC keep suggesting having a client->server encryption method which sorta defeats the purpose of 2 people having private messages.

Other chat services have implemented a client->client encryption (which is where the encryption should be taking place so as to not DDOS servers from an SSL drone net). AIM actually does SSL without having to direct connect. The client simply tries to negotiate an SSL key exchange when you open an IM window. mIRC should be the same way, it should try to do a key exchange when a PRIVMSG window is opened to another user.