Someone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can too - eviltoast
  • Deceptichum@kbin.social
    link
    fedilink
    arrow-up
    16
    ·
    11 months ago

    Yeah but damn does it get slow.

    I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.