mysql-dynamo-pump

Pump data from a mysql databse to aws dynamo db.

npm install mysql-dynamo-pump
3 downloads in the last week
12 downloads in the last month

mysql-dynamo-pump

Build Status NPM version

This is just an internal project to be able to pump data from a mysql database into AWS DynamoDB. It's able to pumpe large ammounts of data as fast as your connection and dynamo write throughput allows.

It will not loose data if AWS returns your data by exceed the write throughput. It tries to throttle and accelerate the pumping speed to find the maximum allowed write throughput.

All you have to do is overwrite the methods readSQL() and convertToDynamoItem() and create the config.json file like the config_example.json.

For an example have a look at the file _src/example.coffee

To build it you have to run npm install cli mysql-dynamo-pump.

You can read the console help by starting it with node example.js --help

npm loves you