“Model collapse” threatens to kill progress on generative AIs - eviltoast
Generative AIs start churning out nonsense when trained on synthetic data — a problem that could put a ceiling on their ability to improve.
  • Bezier@suppo.fiEnglish
    3·
    2 months ago

    Didn’t think of that, good point.

    The inbreeding could also affect larger decisions in sneaky ways, like how it wants to compose the image. It would be bad if the generator started to exaggerate and repeat some weird ai tropes.