Code:
on *:text:*:?:{
  $+(.timer,pm,$nick) 1 60 close -m $nick
}

Waits for 60 seconds after the last message was received then closes the query/pm window

Change 60 to the number of seconds you want it to wait