new TokenizerBuilder(option)
TokenizerBuilder create Tokenizer instance.
Parameters:
| Name | Type | Description | ||||||
|---|---|---|---|---|---|---|---|---|
option |
Object | JSON object which have key-value pairs settings
Properties
|
- Source:
Methods
-
build(callback)
-
Build Tokenizer instance by asynchronous manner
Parameters:
Name Type Description callbackTokenizerBuilder~onLoad Callback function - Source:
Type Definitions
-
onLoad(err, tokenizer)
-
Callback used by build
Parameters:
Name Type Description errObject Error object tokenizerTokenizer Prepared Tokenizer - Source: