WS_EX_LAYERED (& thus SetLayeredWindowAttributes()) can't be used on a child window.

From the msdn:
WS_EX_LAYERED
Windows 2000/XP: Creates a layered window. Note that this cannot be used for child windows. Also, this cannot be used if the window has a class style of either CS_OWNDC or CS_CLASSDC.