Use comma for delimiter, and escape any comma in the data by enclosing that entry in quotes.
Data: 225 | 2,500 | 450
CSV: 225,“2,500”,450
Comment on Just the way we likes it.
espurr@sopuli.xyz 5 weeks agoWhat delimiter should I be using instead of commas?
emergencyfood@sh.itjust.works 5 weeks ago
death_to_carrots@feddit.org 5 weeks ago
Semi-colons. Tabulators. Something not in the actual strings. However the Python CSV module it formats.
Jason2357@lemmy.ca 5 weeks ago
The delimiter isn’t really the issue. Its that there are lots and lots of weird edge cases that break reading csvs. If you use commas, at minimum, you need to escape commas in the data, or quote strings that might contain commas… But now you have to deal with the possibility of a quote character or your escape character in the data.
Then you have the fact that csvs can be written with so many different character encodings, mangling special characters where they occur.
Aaand then you have all the issues that come with lack of metadata - good formats will at least tell you the type of data in each column so you dont have to guess them.
Lets see, its also really annoying to include any binary data in a csv, theres no redundancy or parity checks to catch currupted data, and they arent compressed so you need to tack on compression if you want efficient storage, but that means you always have to read the whole csv file for any task.
Oh, that brings me to the joys of modern columnar formats where you can read selected columns super fast without reading the whole file.
Oh god, I really kept going there. Sorry. Its been a year.
espurr@sopuli.xyz 4 weeks ago
No that was really cool, what’s an exaple of modern format? CSV sounds kinda not based
I_am_10_squirrels@beehaw.org 5 weeks ago
Alt-008
rustydrd@sh.itjust.works 5 weeks ago
🤪 as a delimiter
🥦 for end of line