The idle time for the channel will only be displayed if the person using the dialog is also on the channel, so that the channel idle time is (for the most part) correct. This information is gathered using $nick($chan,<nick>).idle, not the idle time returned via the /whois command, which is the idle time on the server.
