Search results
146 packages found
Parse and manipulate tokenized strings with ease!
Split text into tokens.
Tokenize Excel formulas
Time a JavaScript tokenizer
it extracts the word of a given index in a text
Lexical analyzer built in Javascript
- lex
- lexer
- lexical
- analysis
- scan
- scanner
- scanning
- token
- tokenize
- tokenizer
- flex
- language support
- built in
- javascript
A CLI tool for converting JSX files into standard JS.
A fast tokenizer/lexer core that is well tested.
Parsing and tokenizing attributes string
Tokenize JavaScript
Generate the Abstract Syntax Tree (AST) of a Bash command.
Create a string representation of an object or primative
[![Build Status](https://travis-ci.org/kmsheng/tibetan-tokenize.svg?branch=master)](https://travis-ci.org/kmsheng/tibetan-tokenize)
POS Tagger and lemmatizer for javascript
Tokenizes an HTML string, extracting plain text while ignoring HTML tags
docast utility to parse docblocks
String ngram splitter.
Splits a JSON string into an annotated list of tokens