LLMs are surprisingly great at compressing images and audio, DeepMind researchers find - eviltoast
Despite being primarily trained on text, these models achieved remarkable compression rates on image and audio data.
  • Mossy Feathers (She/They)@pawb.socialEnglish
    332·
    1 year ago

    Honestly? I’m not super surprised by this. The human brain (and I assume brains in general) are really good at data compression. Considering neural networks are more or less meant to mimic different aspects of the human brain, it doesn’t surprise me too much that they’d be really good at data compression as well.