Zokeniter

Node tokenizer utility

Takes a string with words separated by spaces and returns an array.

It will keep quoted tokens together.

Example: 'I am a "quoted string"' -> [ 'I', 'am', 'a', 'quoted string']

Using it

Contrived Example:

Contributing

First, setup your local environment:

git clone git@github.com:ZeroarcSoftware/zokentier.git
cd zokentier
npm install

Next, build the project (for use in a npm link scenario):

npm run build

To watch for changes:

npm run watch

Issues

Issues are tracked in Github Issues.

Changes

Changes are tracked as Github Releases.