csv-split-stream
Splits a CSV read stream into multiple write streams.
Install
npm install csv-split-stream
Usage
- Split a local CSV file into multiple CSV files (10000 lines each, excluding the header row):
const csvSplitStream = ; return csvSplitStream;
- Download a large CSV file via HTTP, split it into chunks of 10000 lines and upload each of them to s3:
const http = const csvSplitStream = ;const AWS = const s3Stream = ; { http; }