You could try stopping them with a var statment and other thingy, but why?
The reason for this is because when you are opped, a server re-sends the channel modes.
Sometimes you will see this twice, others you won't (its very strange, but meh).
This is because some modes can only be seen by a channel operator.