Petabyte level storage setup? - eviltoast

Hi there, I am trying to setup a high-availability high-performance Storage and I have no idea where to start at all. and I have a list of question i hope you could help me with.

Do i need SAN or DAS that connect to multiple control node?
What file system? and I want to avoid Lusterfs
What hardware do i need?
What Os do i use? i ideally want to use truenas but i am comfortable with another distro.

the storage need to beable to scale to petabyte level and ideally FAST

  • ryuujinzero@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    As for hardware, there are 60 bay rackmount chassis out there that you can outfit with 60 20TB drives, which would give you just over 1.2PB. You would need a motherboard with enough PCIe lanes to use the needed number of HBA cards. If you went with HBA cards that can support 16 drives, you’d need 4 for 60 drives. I personally use the Pro WS WRX80E-SAGE SE WIFI, which might be overkill for your scenario, but the 7 16x lanes allows me 4x HBA cards + 1 GPU for Plex hardware transcoding/Steam streaming + 2 Hyper M.2 expansion cards for cache.