Fine! .csv.gz ftw!
Comment on Pandas
gigachad@sh.itjust.works 1 month agoI guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
ikilledlaurapalmer@lemmy.world 1 month ago
Comment on Pandas
gigachad@sh.itjust.works 1 month agoI guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient
Fine! .csv.gz ftw!
zaphod@sopuli.xyz 1 month ago
CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.
Diplomjodler3@lemmy.world 1 month ago
Why do you have to personally attack me like that?
naught@sh.itjust.works 1 month ago
Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️