Browse by Keyword: "tokenizer"

Page 1

atok Fast, easy and dynamic tokenizer for Node Streams

cljs-parser Clojurescript parser

cljs-tokenizer Clojurescript tokenizer

glsl-tokenizer r/w stream of glsl tokens

high5 (eventually) spec-compliant html 5 parser

javascript-tokenizer Tokenizers your javascripts

jison A parser generator with Bison's API

jison-lex lexical analyzer generator used by jison

json-tokenizer A streaming JSON tokenizer

kodetokenizer Generic source code tokenizer

lex An elegant armor-plated JavaScript lexer modelled after flex. Easily extensible to tailor to your need for perfection.

lexxy lexxy is a simple lexer for Node.js.

literalizer Specialized heuristic lexer for JS to identify complex literals

nlp-toolkit A little helper module to execute nlp operations

node-tokenizer A tokenizer written in JavaScript.

parser-toolkit Toolkit to make streamable scanners and parsers.

pstrscan A simple, fast string tokenizer for lexical scanning operations.

ret Tokenizes a string that represents a regular expression.

search-text-tokenizer A tokenizer for Google-like search text

sentence-tokenizer Tokenize paragraphs into sentences, and smaller tokens.

sexp-tokenizer Streaming s-expression tokenizer

str-reader Primitive string parsing.

stream-csv-enhanced stream-csv-enahnced is a collection of node.js 0.10 stream components for creating custom standard-compliant CSV processors, which requires a minimal memory footprint. It can parse CSV files far exceeding available memory. Even individual data items are streamed piece-wise. Streaming SAX-inspired event-based API is included as well.

stream-json stream-json is a collection of node.js 0.10 stream components for creating custom standard-compliant JSON processors, which requires a minimal memory footprint. It can parse JSON files far exceeding available memory. Even individual data items are streamed piece-wise. Streaming SAX-inspired event-based API is included as well.

StringScanner StringScanner performs lexical scanning operations on a string.

stringtokenizer String parsing component for Nodejs.

tokenhunter Functional token parser for JavaScript

twokenize Nodejs port and update of Jason Baldrige's Twokenize with layers for common twitter patterns

unicode-tokenizer Unicode Tokenizer for line breaking.

Page 1

npm loves you