Moving and processing data

Data can be moved with scp, e.g.:

scp -i ~/.ssh/sh-batch.pem c01.dmorina.com:bang/.data/users .data

There are also tools in bangData.js which can be used to download and process data. In particular, you will need to run saveDBArchives() and useCompleteBatches(manipulationFix) in order to load the data into our R scripts.