Is there a good ai thats run fast on a amd rx 7600? - eviltoast

Ive been playing koboldai horde but the queue annoys me. I want a nsfw ai for playing on tavernai chat

  • projectmoon@lemm.ee
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 months ago

    Install ollama. It has ROCm support (on Linux at least). Then hook it up to your favorite client. It has its own API and an openai compatible one.