sitescrapr

0.0.1 • Public • Published

sitescrapr

Simple website crawler and content scraper.

Author

Steve Veerman

About

The purpose of sitescrapr is to provide a framework to scrape content from a particular website.

Most sitescrapr projects will follow this pattern:

  1. Get "search results/listings"
  2. Parse "search results/listings" and save "item links"
  3. Get all "items" from "item links"
  4. Parse all "items"
  5. Save all "items"

Usage

Please see sitescrapr-example for more documentation and working example.

$ npm install sitescrapr

History

0.0.1

  • Initial sitescrapr implementation.

License

(The MIT License)

Package Sidebar

Install

npm i sitescrapr

Weekly Downloads

2

Version

0.0.1

License

MIT

Last publish

Collaborators

  • veerman