$1-: hel. lo my dog is eat. ing a cat!
/untokenize 46 $1-
$1: hel lo
$5: eat ing
Basicly instead of seperating tokens, it combins them.
That doesnt make sence to me, your saying if it encounters a token seperator at the end of a $x join it to the next one?
Well assumuing you have spaces as your standard $x seperators you could do.
/tokinize 255 $replacex($1-,. $+ $chr(32),$chr(32),$chr(32),$chr(255))
