With maximized MDI windows, when you leave fullscreen mode, the MDI icon of the currently active MDI window disappears. It reappears when (for example) switching windows.
I was able to reproduce an issue with minimized MDI icons being hidden when I toggle fullscreen mode. If I use the arrange icons option in the Window menu they become visible again. Is that the same issue?