How many people in the channel? The server probably has a choke on how many whois requests you can make in such a short time. It probably throttles down your request and sends the whois info bck to you at a safer speed.
You know about /who $chan and watching the raw 32 event for the user info?
