Some IRC servers hide your IP/hostname by scrambling part of it. I'll give you an example.
I can connect with the full address: Watchdog!Blah@CPE-203-51-8-100.nsw.bigpond.net.au
Yet only myself and opers can see this.
All other chatters see this instead: Watchdog!Blah@=kT56c.nsw.bigpond.net.au
The red bit is the scrambled bit, in this case hiding all digits in my hostname. Some servers have this ability while others do not. All that you need to do is find out if your server does it and if not then people will be able to see your IP or hostname.
Options:
1. Connect through a BNC or Proxy
Advantages: Your real IP/hostname is hidden
Disadvantages: More lag and less security.
2. Use an IRC server that does the above-mentioned hostname masking for you.
Advantages: The best security available.
Disadvantages: None.
3. Do as you do now, but realise that people knowing your IP can lead to problems.