Even if you block everything, they are still sending gigabytes of data down the connection which has to be processed by something eventually, displacing bandwidth for legitimate connections. Falsified IPs makes this problem even more difficult to deal with.
(If isps out there would just block outbound traffic that is obviously fake it'd make things soo much easier)