Would be interesting to have a Large Language Model fine-tuned on leftist sources - eviltoast

It would be interesting to have a Large Language Model (LLM) fine-tuned on the ProleWiki and leftist books, as it could be very useful for debunking arguments related to leftist ideology. However, local models are not yet doing search and cited sources, which makes it difficult to trust them. With citations, it is possible to check if the model is referencing what it is citing or just making things up. The inclusion of citations would enable users to verify the references and ensure the model is accurately representing the sources it cites. In the future, when a local platform with search capabilities for LLMs becomes available, it would be interesting to prioritize leftist sources in the search results. Collaboratively curating a list of reliable leftist sources could facilitate this process. What are your thoughts on this?

    • albigu@lemmygrad.ml
      link
      fedilink
      arrow-up
      5
      ·
      1 year ago

      Well yes, but the one it talked about was the SMO. Ukraine didn’t exist to libs before then. I tried replicating it and they seem to have fixed it now, but the other day I also managed to get it to talk about the Wagner “rebellion” so there’s definitely some data leakage in there.