I believe the best way to go about this is to use the /notify function. Add the nick you're wanting take possesion of, as soon as it goes offline to your notify list. Then take a look at /help on unotify.