Agreed nice idea, perhaps also an option that enables that always, unless the window is explicitly closed.
Also I think the window should remove the nick list and editbox when not joined to the channel, as an indicator (perhaps just a background color change for the editbox). And when the channel is rejoined, the editbox and nick list are simply added back in to the window; channel text would be undisturbed!