What was the ban mask that'd do something like that? It could well be a bug in the IRCd.
Try /mode #channel -b ban!mask@here - to see what the exact ban mask is use /mode #channel b and look in the Status window. You may also want to get everyone (including yourself) to leave the channel, all bans are usually unset when a room is emptied.
Regards,