I think it would be a good idea to keep the channel window open when you are kicked also. Could be useful to see exactly why you were kicked. It only remains open when rejoin is enabled at present.