UNPKG

crawler-user-agents

Version:

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

github.com/monperrus/crawler-user-agents

monperrus/crawler-user-agents

1 folder, 20 files

	Filename	Content Type	Size
	.github/	–	4.06 kB
	.travis.yml	text/yaml	364 B
	LICENSE	text/plain	1.08 kB
	MANIFEST.in	text/plain	15 B
	README.md	text/markdown	3.94 kB
	__init__.py	application/octet-stream	1.58 kB
	composer.json	application/json	705 B
	crawler-user-agents.json	application/json	177 kB
	format.js	text/javascript	1.22 kB
	go.mod	application/octet-stream	57 B
	go.sum	application/octet-stream	0 B
	index.d.ts	text/typescript	331 B
	main.php	application/octet-stream	205 B
	package.json	application/json	683 B
	pyproject.toml	application/toml	602 B
	test_harness.py	application/octet-stream	1.35 kB
	test_validation.py	application/octet-stream	7.23 kB
	validate.go	application/octet-stream	12.6 kB
	validate.php	application/octet-stream	766 B
	validate.py	application/octet-stream	4.13 kB
	validate_test.go	application/octet-stream	14.1 kB

About

github.com/monperrus/crawler-user-agents

monperrus/crawler-user-agents

Releases

5 hours ago