new TokenizerBuilder(option)
TokenizerBuilder create Tokenizer instance.
Parameters:
Name | Type | Description | ||||||
---|---|---|---|---|---|---|---|---|
option |
Object | JSON object which have key-value pairs settings
Properties
|
- Source:
Methods
-
build(callback)
-
Build Tokenizer instance by asynchronous manner
Parameters:
Name Type Description callback
TokenizerBuilder~onLoad Callback function - Source:
Type Definitions
-
onLoad(err, tokenizer)
-
Callback used by build
Parameters:
Name Type Description err
Object Error object tokenizer
Tokenizer Prepared Tokenizer - Source: