How do social media companies like twitter or youtube not run out of space for posts? - eviltoast

I know memory is fairly cheap but e.g. there are millions of new videos on youtube everyday, each probably few hundred MBs to few GBs. It all has to take enormous amount of space. Not to mention backups.

  • asteroidrainfall@kbin.social
    link
    fedilink
    arrow-up
    7
    ·
    1 year ago

    Yeah this seems false. SD cards are unreliable, hard to keep track of, and don’t actually store that much data for the price. I do think they use tapes though to store long term, low traffic data.

    • zalack@kbin.social
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      1 year ago

      We use LTO tapes in Hollywood to back up raw footage; it wouldn’t surprise me if AWS uses tapes for glacier.

      I got a tour of Iron Mountain once (where we sent tapes for long term archival). They had a giant room with racks and racks of LTOs, and a robot on rails that would make copies of each tape at regular intervals to keep the data from corrupting. It looked kinda like the archive room in Rogue One. Wouldn’t surprise me if Iron Mountain was an inspiration for the design. Super interesting.

      • LostXOR@kbin.social
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        That sounds really cool! I wonder what sort of redundancy they have in case a tape gets damaged or corrupted.

    • assembly@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Used to work there but it’s been a few years so maybe things changed but that was how we originally got super cheap and durable s3.