You need to set the person who kicks you with a global variable and upon returning and re-opping, you kick that person according to the variable and then unset it.