tokenize

0.0.3 • Public • Published

tokenize NPM version Downloads Build Status Coveralls Status

JavaScript tokenizer

Example:

var tokenize = require('tokenize');
tokenize('dad cat', [{type: "variable", regex: /[a-z]+/},{type:"whitespace", regex: /\s/}], function(err,results){
})

/tokenize/

    Package Sidebar

    Install

    npm i tokenize

    Weekly Downloads

    55

    Version

    0.0.3

    License

    MIT

    Last publish

    Collaborators

    • bifodus