wink-tokenizer
Version:
Multilingual tokenizer that automatically tags each token with its type
| Filename | Content Type | Size | |
|---|---|---|---|
| 42 kB | |||
| 588 B | |||
| 51.1 kB | |||
| 388 B | |||
| 361 B | |||
| 3.22 kB | |||
| 5.96 kB | |||
| 1.12 kB | |||
| 4.81 kB | |||
| 1.4 kB |
Multilingual tokenizer that automatically tags each token with its type
| Filename | Content Type | Size | |
|---|---|---|---|
| 42 kB | |||
| 588 B | |||
| 51.1 kB | |||
| 388 B | |||
| 361 B | |||
| 3.22 kB | |||
| 5.96 kB | |||
| 1.12 kB | |||
| 4.81 kB | |||
| 1.4 kB |