“Model collapse” threatens to kill progress on generative AIs - eviltoast
  • BlackLaZoR@fedia.io
    link
    fedilink
    arrow-up
    32
    arrow-down
    3
    ·
    2 months ago

    So they made garbage AI content, without any filtering for errors, and they fed that garbage to the new model, that turned out to produce more garbage. Incredible discovery!

    • Pennomi@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      2 months ago

      Yeah, in practice feeding AI its own outputs is totally fine as long as it’s only the outputs that are approved by users.

      • Bezier@suppo.fi
        link
        fedilink
        English
        arrow-up
        4
        ·
        2 months ago

        I would expect some kind of small artifacting getting reinforced in the process, if the approved output images aren’t perfect.

        • Pennomi@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          2 months ago

          Only up to the point where humans notice it. It’ll make AI images easier to detect, but still pretty for humans. Probably a win-win.

          • Bezier@suppo.fi
            link
            fedilink
            English
            arrow-up
            3
            ·
            2 months ago

            Didn’t think of that, good point.

            The inbreeding could also affect larger decisions in sneaky ways, like how it wants to compose the image. It would be bad if the generator started to exaggerate and repeat some weird ai tropes.

      • WalnutLum@lemmy.ml
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        I don’t know if thinking that training data isn’t going to be more and more poisoned by unsupervised training data from this point on counts as “in practice”