[Question] What are some good selfhostable ChatGPT alternatives? - eviltoast

What the title says. Are there any good ChatGPT alts that can be self hosted?

  • zephyrvs@lemmy.ml
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    1 year ago

    Llama.cpp + Wizard Vicuna (Uncensored, if you want to get the real thing) + one of the web interfaces that are compatible. Should be listed in the readme.

    Or try gpt4all which is much easier to use and even offers a selection of downloadable models.

    7B/13B/30B+ depends on your hardware, especially GPU.

  • frap129@lemmy.maples.dev
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    1 year ago

    I use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.

  • HumanPerson@sh.itjust.works
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    I believe gpt4all has a self-hostable web interface but I could be wrong. Still it can run on relatively low end hardware (relatively because it still needs a decent amount) and you could just use it on your local computer.

  • Admiral Patrick@dubvee.org
    link
    fedilink
    arrow-up
    4
    arrow-down
    20
    ·
    edit-2
    1 year ago

    SearxNG is my favorite.

    It’s a meta search engine that makes it easy to find what you’re looking for without ads, tracking, or SEO crap.

    From there, you can train your own, built-in neural net to earn the knowledge for yourself :)