I haven't been able to reproduce this yet but, as it has been reported a few times it, it may be a common issue. As far as I can tell, seeing these windows or their taskbar buttons should not be possible, unless Windows is doing something wrong or another application is changing them in some way. I am going to make a change to how they work that hopefully mitigates this. The change should be in the next beta.