crawler-indexer

Branch	Status
master
develop

A crawling and indexing library to build crawlers and indexers with.

Getting Started

Install the module with: npm install crawler-indexer

var Crawler = require('crawler-indexer').Crawler;
var Indexer = require('crawler-indexer').Indexer;
 
var indexer = Indexer.create(options, overrides);
indexer.start();
var crawler = Crawler.create(options, overrides);
crawler.start();

Documentation

(Coming soon)

Examples

(Coming soon)

Contributing

In lieu of a formal styleguide, take care to maintain the existing coding style. Add unit tests for any new or changed functionality. Lint and test your code using Grunt.

Release History

(Nothing yet)

License

Copyright (c) 2014 Niels Henrik Hagen. Licensed under the MIT license.