How would you build a GPU-heavy node? - eviltoast

Simple as that, I have a few GPUs hanging around and I want to build a GPU node for my kubernetes cluster. I already have one, GPUs are attached and it can do cool things like transcoding plex easy enough, but I’m starting to look to the horizon for my next big projects.

So, dream machine, how could I accomplish building a big ol’ server with the GPUs I have hanging around and maybe a new one?

What CPU/Mobo, and maybe most important, power supply, would you recommend for running maybe even 4x GPUs? Or maybe just 3 and I’m being crazy.

Won’t be building tomorrow like I said, but I just thought of this and was like “man, I bet not a lot of consumer hardware would support this…”

  • towerful@programming.dev
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    5? Holy heck, that’s amazing. I remember helping people that had built streaming rigs to use during the pandemic, and wondering why their production was stuttering and having issues with a bunch remote callers. Some of that work ended up being CPU bound.
    Although, looks like that patch is for Linux? Not much use if your running vmix or some other windows-only software.
    In OPs case, however, that’s not a problem