if your server using hybrid like efnet and you are @
try this /msg chanserv set #chan mode -k


There is no chanserv on EFnet that is 'interactive'. If he is @Nick on that channel, to manually remove the key : /raw mode #channel -k But chances are (on EFnet) that isn't going to work either.