Yes. If you use someones vps/bouncer they can read your IRC if they wanted to.

Don't use your friends vps/bouncer if you don't trust them.