Ohh I see, I checked the other client's settings and it has "Keep channels open when part" and "Keep channels open when kicked", two separate options.

Your call, thanks for checking.