Thanks for your bug report. I have tested this here and it is working as expected. Can you describe a step by step method that reproduces this for you?
Note that this feature works in a very specific context as described in
versions.txt:
20.Added "Hide away reminders" option to IRC/Options dialog that hides repeat away messages in active query windows for ten minutes.
This means that repeat away messages are hidden in query windows.
Away messages are not hidden in any other windows/contexts.