aliquote.org

March 5, 2019

As I am using Postgresql a lot these days, I thought I would import a large CSV file (1 Go) to see if I can play with in-database tools from dplyr & Co. I will probably need this for work so it’s worth the effort. I started with a Stata file that I read using haven, and I converted it to a CSV using data.table::fwrite. This already eated up all my RAM. Now, I’m using csvkit to import the CSV file into a Postgresql local database. Well, it says a lot about the process: