The first GPT-4-class AI model anyone can download has arrived: Llama 405B - eviltoast
  • sunzu@kbin.run
    link
    fedilink
    arrow-up
    3
    ·
    4 months ago

    I gonna add some RAM with hope I can split original 70b between GPU and RAM. 8b is great what it is as is

    Looks like it should be possible, not sure how much performance hit offloading to RAM will do. Fafo