It would be possible to implement 8-bit or 16-bit colors just by using 1 or 2 consecutive chars instead of 2 numbers.

Of course, this would ruin any chance of backward compatibility (unless one started using another control code) and require the use of a color selection widget.

Besides, anyone using a non-compatible client and a multibyte encoding might see garbage where the color code should be.