What file system do you use and why? - eviltoast
  • aksdb@feddit.de
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    Same experience here. S3 is essentially a key/value store to simply put and retrieve large values/blobs. Everything resembling filesystem features is just convention over how keys are named. Comminication uses HTTP, so there is a lot of overhead when working with it as an FS.

    In the web you can use these properties to your advantage: you can talk to S3 with simple HTTP clients, you can use reverse proxies, you can put a CDN in front and have a static file server.

    But FS utils are almost always optimized for instant block based access and fast metadata responses. Something simple like a find will fuck you over with S3.