Very straigntforward web crawler. Uses EventEmitter. Generates queue statistics and has a basic cache mechanism with extensible backend. -- Read More
INSTALL » npm install simplecrawler
CODE » git clone http://github.com/cgiffard/node-simplecrawler.git
Categories:
Engines:
- node >=0.4.0