It would annoy me as well. When I detach channels and I want them to close. I also have the 'keep channels open' setting enabled.