/help /ignore

/ignore [-lrpcntikdwxu#] <on|off|nick/address> [type] [network]

The -r switch indicates that the address is to be removed.

You can also just bring up the address book and remove it manually.