Browse by Keyword: "crawling"

Page 1

crawlable A way to make your web application crawlable, so it can be well referenced on the web.

crawlable-solidify Some tools to help you to render your application as a static web site using the crawlable module.

crawler Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!

crawler-hq Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!

crawler-mod based on node-crawler

crawlme Makes your ajax web application indexable by search engines by generating html snapshots on the fly. Caches results for blazing fast responses and better page ranking.

krawler Fast and lightweight web crawler with built-in cheerio, xml and json parser.

papermonk Streaming pdf fetcher for academic papers.

papermonk-downloader-plosone plosone.org scraper

session-scraper Simple scraper for imitating browsing sessions

siter Site content parser for popular websites with fallback to Open Graph and Twitter Cards

skrap Easily scrap web pages by providing json recipes

splitzee-crawler Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously. Scraping should be simple and fun!

trawler Express middleware to troll bots. A combination of "trolling" and "crawler", also a boat for catching a lot of fish. Gotta catch 'em all.

twilight Twitter (crawling) tools.

warp Jump right to where you want to be. Easy Web Crawling in JavaScript

web-crawler Scalable, extensible, web crawler framework.

xstruct Implementation of straightforward extraction of structured data from web pages.

Page 1

npm loves you