I quite agree; it makes little sense to go a channel that you don't care to see their channel text. However *shrug* you can put the following remote in your remotes (Alt-R):
Code:

on ^*:TEXT:*:#ThatChannelName: haltdef

DALnet: #HelpDesk and #m[color:#FF0000]IR[color:#EEEE00]C