How would you build a GPU-heavy node? - eviltoast

Simple as that, I have a few GPUs hanging around and I want to build a GPU node for my kubernetes cluster. I already have one, GPUs are attached and it can do cool things like transcoding plex easy enough, but I’m starting to look to the horizon for my next big projects.

So, dream machine, how could I accomplish building a big ol’ server with the GPUs I have hanging around and maybe a new one?

What CPU/Mobo, and maybe most important, power supply, would you recommend for running maybe even 4x GPUs? Or maybe just 3 and I’m being crazy.

Won’t be building tomorrow like I said, but I just thought of this and was like “man, I bet not a lot of consumer hardware would support this…”

  • grue@lemmy.worldEnglish
    3·
    11 months ago

    I’m not sure what’s required for AI. I feel like it is similar to crypto mining, massive compute but relatively small amounts of data.

    If you’re talking about training models, I think it requires both massive compute and massive amounts of data.