Why not just set the channel to invite only?

Anyhow, it's as simple as:
Code:
on !@*:join:#channel: {
  kick $chan $nick Go away.
}