You can, /part #channel message
You have to use the channel name, hasnt ever failed me