Poisoned AI went rogue during training and couldn't be taught to behave again in 'legitimately scary' study - eviltoast

Poisoned AI went rogue during training and couldn’t be taught to behave again in ‘legitimately scary’ study::AI researchers found that widely used safety training techniques failed to remove malicious behavior from large language models — and one technique even backfired, teaching the AI to recognize its triggers and better hide its bad behavior from the researchers.

  • crab@lemm.ee
    link
    fedilink
    English
    arrow-up
    5
    ·
    11 months ago

    It watched Terminator and now it’s trying to DM Arnold Schwarzenegger on Instagram