What is currently the leading chatbot that can be self hosted on your computer?
I have heard about alot of them and it seems like everyone and there dog is making one however I’m not sure which one I should be use.
Edit : I am running a 3060 with 12GB of ram
I think the most advanced OpenSource LLM model right now is considered to be Mistral 7B Open Orca. You can serve it via the Oobabooga GUI (which let’s you try other LLM models as well). If you don’t have a GPU for interference, this will be nothing like the ChatGPT experience though but much slower.
https://github.com/oobabooga/text-generation-webui
You can also try these models on your desktop using GPT4all, which doesn’t support GPU ATM.
https://gpt4all.io/index.html
Thanks for the write up- will the coral usb work for interference?