keywords:web spider - npm search

nodecraw

NodeCraw is a web crawling application that allows you to crawl specified URLs and extract information from web pages. It utilizes various modules and libraries to perform crawling and save the results.

pikpik

published 1.0.7 a year ago

M

Q

P

floodesh

Floodesh is a distributed web spider/crawler written with Nodejs.

mike442144

published 0.8.19 4 years ago

M

Q

P

weaverfi

The NPM package to query DeFi.

ncookie

published 1.38.1 7 months ago

M

Q

P

boloto

node.js web crawler

orzv

published 2.0.1 5 years ago

M

Q

P

syphonx

SyphonX is a tool that extracts data from HTML data, transforming it into JSON of any shape or size. It combines the power of CSS Selectors and jQuery, Regular Expressions, and Javascript into a declarative template format to elegantly solve the simplest

dtempx

published 1.2.66 2 months ago

M

Q

P

@0y0/scraper

A web scraping tool that extracts any data from the web.

shiningjason

published 1.0.0 3 years ago

M

Q

P

@0y0/scraper-extensions

A @0y0/scraper expansion pack.

shiningjason

published 1.0.0 3 years ago

M

Q

P

crawlbug

A NodeJS web crawler that can be deployed to multiple machines and writes page data to a Firebase database.

nebrelbug

published 5.0.2 7 years ago

M

Q

P

rfc-spider

Create web crawlers

fcostarodrigo

published 2.0.1 7 years ago

M

Q

P

gretel

Follows and collects breadcrumbs accross the web

mauricebutler

published 0.0.7 8 years ago

M

Q

P

xlspider

nodejs's web spider tools

xiaolongnice

published 1.0.6 2 years ago

M

Q

P

wet

Grabbing metadata from webpages

fritx

published 0.1.0 9 years ago

M

Q

P

crawlerx

A powerful crawler support strategy to different url, the crawler can traverse all web page in a site recursively with certain deep. of course, you alse can do not use recursive crawel.