UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

6 folders, 25 files

	Filename	Content Type	Size
	../
	bindings/	–	285 kB
	chatWrappers/	–	339 kB
	cli/	–	511 kB
	evaluator/	–	747 kB
	gguf/	–	229 kB
	utils/	–	502 kB
	ChatWrapper.d.ts	text/typescript	2.18 kB
	ChatWrapper.js	text/javascript	10.5 kB
	ChatWrapper.js.map	application/json	8.45 kB
	apiDocsIndex.d.ts	text/typescript	11 B
	apiDocsIndex.js	text/javascript	206 B
	apiDocsIndex.js.map	application/json	259 B
	commands.d.ts	text/typescript	498 B
	commands.js	text/javascript	579 B
	commands.js.map	application/json	442 B
	config.d.ts	text/typescript	3.25 kB
	config.js	text/javascript	6.15 kB
	config.js.map	application/json	5.02 kB
	consts.d.ts	text/typescript	187 B
	consts.js	text/javascript	363 B
	consts.js.map	application/json	430 B
	index.d.ts	text/typescript	14.3 kB
	index.js	text/javascript	6.7 kB
	index.js.map	application/json	3.94 kB
	state.d.ts	text/typescript	397 B
	state.js	text/javascript	610 B
	state.js.map	application/json	575 B
	tsconfig.tsbuildinfo	application/octet-stream	11.2 kB
	types.d.ts	text/typescript	7.57 kB
	types.js	text/javascript	409 B
	types.js.map	application/json	469 B