jwebquery
jQuery like web crawler
Note
It's my first node modules and features are not well tested now.Since it's just a crawler,use it on your own risk.
Feature
- gzip support
- http/https support
- cookie support
- can set page fetch/download interval,and max parallel download limitations.
- http proxy support
- GET method support ,POST is not tested and upload multipart is not supported
- auto add http head Referer
Example
basic
var jwebquery = ;"http://www.stackoverflow.com/"
proxy
//use localhost:8099 as http proxyjwebquery;