The AI feedback loop: Researchers warn of ‘model collapse’ as AI trains on AI-generated content - eviltoast
  • FaceDeer@kbin.social
    link
    fedilink
    arrow-up
    14
    arrow-down
    4
    ·
    9 months ago

    This article is from June 12, 2023. That’s practically stone-aged as far as AI technology has been progressing.

    The paper it’s based on used a very simplistic approach, training AIs purely on the outputs of its previous “generation.” Turns out that’s not a realistic real-world scenario, though. In reality AIs can be trained on a mixture of human-generated and AI-generated content and it can actually turn out better than training on human-generated content alone. AI-generated content can be curated and custom-made to be better suited to training, and the human-generated stuff adds back in the edge cases that might disappear when doing repeated training generations.