codsen-tokenizer
HTML and CSS lexer aimed at code with fatal errors, accepts mixed coding languages
## Install
This package is [pure ESM](https://gist.github.com/sindresorhus/a39789f98801d908bbc7ff3ecc99d99c). If you're not ready yet, install an older version of this program, 5.6.0 (`npm i codsen-tokenizer@5.6.0`).
```bash
npm i codsen-tokenizer
```
## Quick Take
```js
import { strict as assert } from "assert";
import { tokenizer } from "codsen-tokenizer";
const gathered = [];
// it operates from a callback, like Array.prototype.forEach()
tokenizer("", {
tagCb: (obj) => {
gathered.push(obj);
},
});
assert.deepEqual(gathered, [
{
type: "tag",
start: 0,
end: 11,
value: " | ",
tagNameStartsAt: 1,
tagNameEndsAt: 3,
tagName: "td",
recognised: true,
closing: false,
void: false,
pureHTML: true,
kind: null,
attribs: [
{
attribName: "nowrap",
attribNameRecognised: true,
attribNameStartsAt: 4,
attribNameEndsAt: 10,
attribOpeningQuoteAt: null,
attribClosingQuoteAt: null,
attribValueRaw: null,
attribValue: [],
attribValueStartsAt: null,
attribValueEndsAt: null,
attribStarts: 4,
attribEnds: 10,
attribLeft: 2,
},
],
},
]);
```
## Documentation
Please [visit codsen.com](https://codsen.com/os/codsen-tokenizer/) for a full description of the API.
## Contributing
To report bugs or request features or assistance, [raise an issue](https://github.com/codsen/codsen/issues/new/choose) on GitHub.
## Licence
MIT License.
Copyright © 2010-2024 Roy Revelt and other contributors.
  
|