Search results

@crawlify.io/robots

Parses robots.txt files to provide meaningful, useful output as well as reporting syntax errors.

• robots.txt
• parse
• seo
• meta
• crawl
• scraper
• robots

_j4wx

published 1.0.1 • 5 years agopublished 1.0.1 5 years ago

broken-links-inspector

Extract and recursively check all URLs reporting broken ones

• 404
• broken
• links
• checker
• inspector
• hyperlink
• seo
• bad
• html
• URL

dbogatov

published 1.4.0 • 3 years agopublished 1.4.0 3 years ago

@dbogatov/broken-links-inspector

Extract and recursively check all URLs reporting broken ones

• 404
• broken
• links
• checker
• inspector
• hyperlink
• seo
• bad
• html
• URL

dbogatov

published 0.2.1 • 4 years agopublished 0.2.1 4 years ago