I found that by switching from psybnc to znc, this error was reduced significantly.