DuckDuckGo AI Chat adds support for Llama 3 70B and Mixtral 8x7B - eviltoast
  • pflanzenregal@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    5 months ago

    Open-webui is the best self hosted LLM chat interface IMO. It works seamlessly with Ollama, but also supports other openAI-API compatible APIs AFAIK.

    I’m using both in combination with each other and both downloading and using models is super easy. Also integrates well with VSCode extension “Continue”, an open source Copilot alternative (setup might require editing the extension’s config file).