Yeah I figured it might be that, however I find it extremely unusual since I was on the same amount of networks/channels on my old PC that only had 1GB ram, some old P4 processor and was running XP SP2 and everything was fine there. This pc has Q6600 quad, 4GB of ram and Vista 64bit so it's definitely not lack of resources as I have plenty.
