Thanks for your bug report. As far as I know, this is how full screen should work. I just tested this with Firefox and Notepad++ and they both do the same thing in full screen mode. When "hide taskbar" is enabled in Windows, the taskbar will not become visible when an application is in full screen mode.
