Hellfire103@lemmy.ca to linuxmemes@lemmy.worldEnglish · 8 天前Distro Focuseslemmy.caexternal-linkmessage-square227fedilinkarrow-up1953arrow-down114
arrow-up1939arrow-down1external-linkDistro Focuseslemmy.caHellfire103@lemmy.ca to linuxmemes@lemmy.worldEnglish · 8 天前message-square227fedilink
minus-square1985MustangCobra@lemmy.calinkfedilinkEnglisharrow-up6·8 天前i tried living in the terminal but i had no one to talk to
minus-squareZachariah@lemmy.worldlinkfedilinkarrow-up8·8 天前We’re in your terminal: https://github.com/LunaticHacker/lemmy-terminal-viewer
minus-square1985MustangCobra@lemmy.calinkfedilinkEnglisharrow-up4·8 天前sadly based on the latest issues submitted and my experience, the app no longer works: https://github.com/LunaticHacker/lemmy-terminal-viewer/issues/11
minus-squareLucy :3@feddit.orglinkfedilinkarrow-up1·8 天前If you have a decent GPU or CPU, you can just set up ollama with ollama-cuda/ollama-rocm and run llama3.1 or llama3.1-uncensored.
minus-square1985MustangCobra@lemmy.calinkfedilinkEnglisharrow-up2·8 天前I have a ryzen 5 laptop. not really decent enough for that workload. and im not crazy about AI.
minus-squareLucy :3@feddit.orglinkfedilinkarrow-up1·8 天前I bet even my Pi Zero W could run such a model* * with 1 character per hour or so
minus-square1985MustangCobra@lemmy.calinkfedilinkEnglisharrow-up2·8 天前interesting, well it’s something to look into, but id like a place to communicate with like minded people.
i tried living in the terminal but i had no one to talk to
We’re in your terminal: https://github.com/LunaticHacker/lemmy-terminal-viewer
sadly based on the latest issues submitted and my experience, the app no longer works: https://github.com/LunaticHacker/lemmy-terminal-viewer/issues/11
😍
If you have a decent GPU or CPU, you can just set up ollama with ollama-cuda/ollama-rocm and run llama3.1 or llama3.1-uncensored.
I have a ryzen 5 laptop. not really decent enough for that workload. and im not crazy about AI.
I bet even my Pi Zero W could run such a model*
* with 1 character per hour or so
interesting, well it’s something to look into, but id like a place to communicate with like minded people.