@Comprehensive49 - eviltoast
  • 11 Posts
  • 36 Comments
Joined 1 year ago
cake
Cake day: June 12th, 2023

help-circle





  • This isn’t really a significant player in the space yet. This field of local LLM frontends is extremely active right now, with many new projects popping up and user counts shifting around. Here’s a good article that reviews the most prominent ones right now, with rankings for different uses: https://matilabs.ai/2024/02/07/run-llms-locally/

    TLDR from the article:

    Having tried all of these tools, I find they are trying to solve for a few different problems. So, depending on what you are looking to do, here are my conclusions:

    • If you are looking to develop an AI application, and you have a Mac or Linux machine, Ollama is great because it’s very easy to set up, easy to work with, and fast.
    • If you are looking to chat locally with documents, GPT4All is the best out of the box solution that is also easy to set up
    • If you are looking for advanced control and insight into neural networks and machine learning, as well as the widest range of model support, you should try transformers
    • In terms of speed, I think Ollama or llama.cpp are both very fast
    • If you are looking to work with a CLI tool, llm is clean and easy to set up
    • If you want to use Google Cloud, you should look into localllm
    • For native support for roleplay and gaming (adding characters, persistent stories), the best choices are going to be textgen-webui by Oobabooga, and koboldcpp. Alternatively, you can use ollama with custom UIs such as ollama-webui






  • This tech is just a reskinned dehumidifier. The scientist Youtuber Thunderf00t has made a number of videos debunking these types of claims. Their issues can be summed up as the following:

    • they extract very little water while using a shitton of energy. The amount of energy required to condense water from gas into liquid equals the amount of energy required to boil said water, which is a lot. This is dictated by the laws of physics.
    • they work best in humid conditions. These conditions only exist in places where you would ALREADY be able to find water, or when it is right about to rain ( as the natural humidity condenses to form rain clouds), in which case you can just catch and drink that.
    • the water they produce is not clean. Do you want to drink the moldy water out of your dehumidifier? Model and bacteria grow on the cold, wet metal fins where the water condenses.





  • It’s ridiculous that this needs to be done. Water utilities are the definition of a public good and natural monopoly. Any developing country whose water utilities are privately owned will have water access and shortage issues, as the “costs” of the infrastructure to provide drinking water to all threaten the easy profit of sitting back and forcing people to pay, lest they die from disease or dehydration.