Now it's entirely possible to script, but could turn out to be a bit bothersome; but I think I could find being able to tokenize something by a regexp would be handy-dandy.

SURE you may say we have it already; but thats in 3 or 4 lines of code and testing. I just don't have the finger muscles to type that much.

/tokenize -r <regexp> <text>