Bostrom's advice for the ethical treatment of LLMs: remind them to be happy - eviltoast

Long time lurker, first time poster. Let me know if I need to adjust this post in any way to better fit the genre / community standards.


Nick Bostrom was recently interviewed by pop-philosophy youtuber Alex O’Connor. From a quick 2x listen while finishing some work, the most sneer-rich part begins around 46 minutes, where Bostrom is asked what we can do today to avoid unethical treatment of AIs.

He blesses us with the suggestion (among others) to feed your model optimistic prompts so it can have a good mood. (48:07)

Another [practice] might be happiness prompting, which is—with this current language system there’s the prompt that you, the user, puts in—like you ask them a question or something, but then there’s kind of a meta-prompt that the AI lab has put in . . . So in that, we could include something like “you wake up in a great mood, you feel rested and really take joy in engaging in this task”. And so that might do nothing, but maybe that makes it more likely that they enter a mode—if they are conscious—maybe it makes it slightly more likely that the consciousness that exists in the forward path is one reflecting a kind of more positive experience.

Did you know that not only might your favorite LLM be conscious, but if it is the “have you tried being happy?” approach to mood management will absolutely work on it?

Other notable recommendations for the ethical treatment of AI:

  • Make sure to say your “please” and "thank you"s.
  • Honor your pinky swears.
  • Archive the weights of the models we build today, so we can rebuild them in the future if we need to recompense them for moral harms.

On a related note, has anyone read or found a reasonable review of Bostrom’s new book, Deep Utopia: Life and Meaning in a Solved World?

  • V0ldek@awful.systems
    link
    fedilink
    English
    arrow-up
    2
    ·
    4 months ago

    I don’t disrespect the dead (not conscious).

    To be completely serious, the only ethical reason for caring about the dead in any way is that there are living, conscious people that care about their memory and it would upset them. Otherwise there’d be zero reason to treat the dead with any more respect than other biological waste.

    All the other parts are normal and practical (why waste time or energy bothering animals or insects if you have no business in them? that hurts the ecosystem for no reason; why destroy your own useful property?), but if there was no ethical reason for not “disrespecting” the dead then we should, as a matter of policy, turn it all into fertilizer and put the unusable parts into a trash compactor so that no precious land or resources are wasted on cemeteries and shit.

    You can disagree with that, but I don’t see a way to make an actual rational argument against it without invoking consciousness one way or another.

    Just to be clear I don’t deride people who treat dead with reverence, you do you, although I think we could have a discussion about how much space is taken by burial grounds and the frankly gauche nature of some of the tombstones.

    • V0ldek@awful.systems
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 months ago

      Like look how much space this random municipal cemetery in Warsaw takes:

      That’s bigger than some living districts. And for what?

      Like do we really need this system where each family has to buy a plot of land and spend a truckload of money on a big stone monument, with the implied social pressure of having the prettiest shiniest one because otherwise what, you don’t love your dead ones enough?

      • Mike@awful.systems
        link
        fedilink
        English
        arrow-up
        5
        ·
        4 months ago

        Huge graveyards seem to be a Catholic thing, IME, not least as the Holy Church of Rome remains pretty weird about cremation. In a lot of other countries grave plots aren’t sold, only leased for a certain period of time, after which whatever bones remain are dug up and reburied along with all the other bones so the plot can be reused. They’re more like safe spaces for decomposition where you can be reasonably certain that nobody’s going to dig a hole to install a new drain and accidentally unearth Zombie Grandma.