Mounting Backblaze B2: s3fs / rclone / GeeseFS / goofys? - eviltoast

I want to mount some B2 buckets on Linux for read/write access. What do people recommend?

s3fs, rclone or GeeseFS seem to be the sensible choices, but please share your hard-won opinions with me.

edit: or goofys?

  • Deebster@lemmyrs.orgOPEnglish
    2·
    1 year ago

    It’s for storing a few terabytes of fairly static media (for the most part, write-once). The codebases using it don’t natively support object storage (and will be in Docker containers).

    It’s on a Hetzner server, and Backblaze (even after the price increase) will be a lot cheaper than normal drives, although their storage box option is probably better value over about two GB.

    • aksdb@feddit.deEnglish
      6·
      1 year ago

      But the thing is: B2 is cheap for storage, but retrieval and traversal are very expensive. And if that happens transparently on the filesystem (because you accidentally run grep or the service in question regularly hashes the files or something), you would implicitly download everything stored. And IIRC retrieval costs ten times the storage costs… each time.)

    • sixCats@lemmy.dbzer0.comEnglish
      2·
      1 year ago

      I have a similar use case and whilst I’m not quite there yet I’m intending to go with a storage box

      • Deebster@lemmyrs.orgOPEnglish
        3·
        1 year ago

        I plan to switch over later when it makes sense to - the nice thing about Backblaze is that it scales with your storage, whereas with Hetzner you have to jump from 1 TB to 5 TB.

        • sixCats@lemmy.dbzer0.comEnglish
          2·
          1 year ago

          Oh I know, I had the same thoughts

          Object storage does really bad as a filesystem and it may very seriously be cheaper for you to have a 5TB storage box over 2TB of object storage

          S3 has no list operation, so any time the computer wants to “list” a directory in object storage that is expensive