You cant as long as they know your exact nickname. Invisible is so that ppl outside the channel you are in cant "see" info on you by using an ip, they must have your nickname to /whois you, and from outside the channel /names will only show those not set invisible. Helps cut down on spam.
