You can't really add an address but what you could do is make your notify /whois the person when they connect to make sure it really is them.
Normally you would just do /notify <nickname> to add them but to /whois the person add the "+" symbol before <nickname> and it should /whois the person when they connect.
So,
/notify +<nickname>
ie.
/notify +abydos
