Parses robots.txt to js object
npm i @henryclong/robots-parser
Gitgithub.com/henryclong/robots-parser
github.com/henryclong/robots-parser#readme
0
1.0.1
MIT
7 kB
6
3 years ago