A data center fire in South Korea sees 858 TB of government files and 'eight years’ worth of work' stored in the cloud go up in smoke

Comments

• Butterbee@beehaw.org ⁨1⁩ ⁨day⁩ ago

  Now it’s really in the cloud!

  source

  • theangriestbird@beehaw.org ⁨1⁩ ⁨day⁩ ago

    bee facepalm emoji

    source
• doeknius_gloek@discuss.tchncs.de ⁨1⁩ ⁨day⁩ ago

  Allegedly, backups simply couldn’t be kept, due to the G-Drive system’s massive capacity.

  X Doubt. Things like S3 can also store massive amounts of data and still support backups or at least geo replication. It’s probably just a matter of cost.

  But it gets worse. It turns out that before the fire, the Ministry of the Interior and Safety had apparently instructed government employees to store everything in the G-Drive cloud and not on their office PCs.

  Which is totally fine and reasonable? The problem isn’t the order to use the centralized cloud system, but that the system hasn’t been sufficiently secured against possible data loss.

  source

  • GenderNeutralBro@lemmy.sdf.org ⁨1⁩ ⁨day⁩ ago

    If you can’t afford backups, you can’t afford storage. Anyone competent would factor that in from the early planning stages of a PB-scale storage system.

    Going into production without backups? For YEARS? It’s so mind-bogglingly incompetent that I wonder if the whole thing was a long-term conspiracy to destroy evidence or something.

    source

    • dalekcaan@feddit.nl ⁨1⁩ ⁨day⁩ ago

      A conspiracy is always possible of course, but people really do tend to put off what isn’t an immediate problem until it’s a disaster.

      Fukushima springs to mind. The plant had been warned more than a decade before the disaster that an earthquake in the wrong place would result in catastrophe and didn’t do anything about it, and lo and behold…

      source
    • Dragonstaff@leminal.space ⁨1⁩ ⁨day⁩ ago

      I was just thinking that incompetence on this scale is likely deliberate.

      Either some manager refused to pay for backups and they’re too highly placed to hold accountable, or they deliberately wanted to lose some data, but I refuse to believe anyone built this system without even considering off-site backups.

      source
  • Clent@lemmy.dbzer0.com ⁨10⁩ ⁨hours⁩ ago

    Tape backup is still a thing.

    source
  • Damage@feddit.it ⁨1⁩ ⁨day⁩ ago

    It would be useful to know what percentage of the total storage these 858TB are, because that is practically nothing nowadays.

    source
• XenGi@feddit.org ⁨1⁩ ⁨day⁩ ago

  Why didn’t they have an offsite backup if the data was that valueable?

  source

  • theangriestbird@beehaw.org ⁨1⁩ ⁨day⁩ ago

    that’s gonna be an expensive backblaze account

    source

    • 01189998819991197253@infosec.pub ⁨1⁩ ⁨hour⁩ ago

      And now it’s an expensive blaze lol

      source
    • noxypaws@pawb.social ⁨1⁩ ⁨day⁩ ago

      yes it’s expensive. it’s also a basic requirement.

      source

      • -> View More Comments
• sleepundertheleaves@infosec.pub ⁨1⁩ ⁨day⁩ ago

  God, what an obvious and predictable fuckup. That picture is going to show up in baby database administrator textbooks and training slides for decades 😆

  I wonder how many people in South Korea’s government knew this was a disaster waiting to happen but felt like it was disrespectful to speak up?

  source
• belated_frog_pants@beehaw.org ⁨1⁩ ⁨day⁩ ago

  858tb not backed up? Thats paltry in data center terms. 86 x 10tb hard drives? Two of those 45 drive rack mounts worth of backup…

  This was bad data architecture

  source

  • circuscritic@lemmy.ca ⁨1⁩ ⁨day⁩ ago

    There were backups!

    Unfortunately, they were located three rows and two racks down from their source.

    In their defense, they clearly never thought the building would burn down.

    source

    • N0x0n@lemmy.ml ⁨1⁩ ⁨day⁩ ago

      And let’s be fair to them, who’s even heard of lithium batteries catching fire?

      Euhhhh… You sure about that? Maybe you’re beeing sarcastic? But buses lithium batteries catching fire is not something unheard off ! Even a few Teslas burned to the ground went viral in the news !

      source

      • -> View More Comments
• irotsoma@piefed.blahaj.zone ⁨1⁩ ⁨day⁩ ago

  All valuable data should be backed up off site in “cold storage” type places. It’s not that expensive compared to the production storage.

  source
• Trainguyrom@reddthat.com ⁨1⁩ ⁨day⁩ ago

  Something something the cloud is not a backup

  source