It's a feature that is often only available to those who are OPERs on that network, and it's not always +w, on some it's +y
I think on Unreal, an OPER can +y on someone and then for that connection, they will see who is whosing them.
But just because there are only two people on the network (yourself being one of them), it doesn't mean that the other person is doing a whois on you.