You can just add the nick/address to your ignore exceptions. The debug alias gets done first.