Browse by Keyword: "tokenizer"
atok Fast, easy and dynamic tokenizer for Node Streams
cljs-parser Clojurescript parser
cljs-tokenizer Clojurescript tokenizer
glsl-tokenizer r/w stream of glsl tokens
high5 (eventually) spec-compliant html 5 parser
jison A parser generator with Bison's API
jison-lex lexical analyzer generator used by jison
json-tokenizer A streaming JSON tokenizer
kodetokenizer Generic source code tokenizer
lexxy lexxy is a simple lexer for Node.js.
literalizer Specialized heuristic lexer for JS to identify complex literals
nlp-toolkit A little helper module to execute nlp operations
parser-toolkit Toolkit to make streamable scanners and parsers.
pstrscan A simple, fast string tokenizer for lexical scanning operations.
ret Tokenizes a string that represents a regular expression.
search-text-tokenizer A tokenizer for Google-like search text
sentence-tokenizer Tokenize paragraphs into sentences, and smaller tokens.
sexp-tokenizer Streaming s-expression tokenizer
str-reader Primitive string parsing.
stream-csv-enhanced stream-csv-enahnced is a collection of node.js 0.10 stream components for creating custom standard-compliant CSV processors, which requires a minimal memory footprint. It can parse CSV files far exceeding available memory. Even individual data items are streamed piece-wise. Streaming SAX-inspired event-based API is included as well.
stream-json stream-json is a collection of node.js 0.10 stream components for creating custom standard-compliant JSON processors, which requires a minimal memory footprint. It can parse JSON files far exceeding available memory. Even individual data items are streamed piece-wise. Streaming SAX-inspired event-based API is included as well.
StringScanner StringScanner performs lexical scanning operations on a string.
stringtokenizer String parsing component for Nodejs.
twokenize Nodejs port and update of Jason Baldrige's Twokenize with layers for common twitter patterns
unicode-tokenizer Unicode Tokenizer for line breaking.