UNPKG

wink-tokenizer

Version:

Multilingual tokenizer that automatically tags each token with its type

winkjs/wink-tokenizer

3 folders, 7 files

	Filename	Content Type	Size
	.nyc_output/	–	42 kB
	runkit/	–	588 B
	src/	–	51.1 kB
	.jsdoc.json	application/json	388 B
	.nycrc.json	application/json	361 B
	CODE_OF_CONDUCT.md	text/markdown	3.22 kB
	CONTRIBUTING.md	text/markdown	5.96 kB
	LICENSE	text/plain	1.12 kB
	README.md	text/markdown	4.81 kB
	package.json	application/json	1.4 kB

About

winkjs/wink-tokenizer

Releases

4 years ago