Building an early warning system for LLM-aided biological threat creation - eviltoast
We’re developing a blueprint for evaluating the risk that a large language model (LLM) could aid someone in creating a biological threat. In an evaluation involving both biology experts and students, we found that GPT-4 provides at most a mild uplift in biological threat creation accuracy. While this uplift is not large enough to be conclusive, our finding is a starting point for continued research and community deliberation.
  • Umbrias@beehaw.orgEnglish
    13·
    11 months ago

    I feel it’s important to mention that as far as CBRN threats are concerned, biological warfare threats are very real, a serious problem, and admittedly accelerated by ai tools for novel biological structures. Militaries don’t use bio weapons because they suck at military things, largely, but terrorists have and can used bio weapons to terrifying effect. Bio warfare proliferation is difficult to spot and counter.

    To be clear here, open ai is late to the party on this front with a terrible paper, but practically it’s a serious concern, both ai tools and non ai tools lowering the barrier to entry, as well as the fact that any given bio lab essentially looks like a bio warfare lab.