Yes, I have often done the same thing, I like the idea of double clicking because then it's not really an inconvenience. However it should be an option since I'm sure if it isn't there will be hundreds of "the disconnect button doesn't work" posts.
Also, another (sorta) solution is move your switch bar. If the switch bar is on the bottom or the right then the problem disappears.
