@lenml/tokenizers
Version:
a lightweight no-dependency fork of transformers.js (only tokenizers)
| Filename | Content Type | Size | |
|---|---|---|---|
| 1.89 MB | |||
| 230 kB | |||
| 1.08 kB | |||
| 1.67 kB | |||
| 3.26 kB |
a lightweight no-dependency fork of transformers.js (only tokenizers)
| Filename | Content Type | Size | |
|---|---|---|---|
| 1.89 MB | |||
| 230 kB | |||
| 1.08 kB | |||
| 1.67 kB | |||
| 3.26 kB |