I doubt alot of harm could be done from users accidentally accepting chat sessions.
To those who only use networks with masked addressing I am sure the users there will disagree with this. I do too. I enjoy being an 'unknown' on IRC, meaning that being anonymous rocks. When you allow automated DCC or even manual, your IP address is provided to the other party. Something that I can do without.
