This is correct behaviour. All token identifers treat consecutive delimiters as one, and ignore leading and trailing delimiters.
So if your delimiter is a comma ($chr(44)) then these are the same:
hi
,,,,hi,,,,,,,,,,,
,hi,
They all consist of 1 token hi. a delimiter is never part of a token.
Also these 2 would be equivalent
a,b,c,d,e
,,,,a,,,,,,,b,,,,c,d,,,e,,
For both strings the first token is a, the third c and the last e.