IAL adds user info when they join the room. So when you join, those already in the room will not be added to the IAL until you /who $chan.