tokenize

Tokenize the provided string using the Niwen Prism parser.

This sequence of tokens can then be provided to parse or parseDebug.