Nightshade, the free tool that ‘poisons’ AI models, is now available for artists to use - eviltoast
  • Alien Nathan Edward@lemm.ee
    link
    fedilink
    English
    arrow-up
    26
    arrow-down
    4
    ·
    10 months ago

    is anyone else excited to see poisoned AI artwork? This might be the element that makes it weird enough.

    Also, re: the guy lol’ing that someone says this is illegal - it might be. is it wrong? absolutely not. does the woefully broad computer fraud and abuse act contain language that this might violate? it depends, the CFAA has two requirements for something to be in violation of it.

    1. the act in question affects a government computer, a financial institution’s computer, OR a computer “which is used in or affecting interstate or foreign commerce or communication” (that last one is the biggie because it means that almost 100% of internet activity falls under its auspices)

    2. the act “knowingly causes the transmission of a program, information, code, or command, and as a result of such conduct, intentionally causes damage without authorization, to a protected computer;” (with ‘protected computer’ being defined in 1)

    Quotes are from the law directly, as quoted at https://en.wikipedia.org/wiki/Computer_Fraud_and_Abuse_Act

    the poisoned artwork is information created with the intent of causing it to be transmitted to computers across state or international borders and damaging those computers. Using this technique to protect what’s yours might be a felony in the US, and because it would be considered intentionally damaging a protected computer by the knowing transmission of information designed to cause damage, you could face up to 10 years in prison for it. Which is fun because the people stealing from you face absolutely no retribution at all for their theft, they don’t even have to give you some of the money they use your art to make, but if you try to stop them you go to prison for a decade.

    The CFAA is the same law that Reddit co-founder Aaron Swartz was prosecuted under. His crime was downloading things from JSTOR that he had a right to download as an account holder, but more quickly than they felt he should have. He was charged with 13 felonies and faced 50 years and over a million dollars in fines alongside a lifetime ban from ever using an internet connected computer again when he died by suicide. The charges were then dropped.

    • captainthroatfuck@lemm.ee
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      1
      ·
      10 months ago

      It’s not damaging a computer, it’s poisoning the models ai uses to create the images. The program will work just fine, and as expected given the model that it has, the difference is the model might not be accurate. It’s like saying you’re breaking a screen if you’re now looking at a low res version of an image

        • captainthroatfuck@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          ·
          10 months ago

          My big thing here is if there’s no contract, where is the onus for having correct models? Yah, the models are worth money, but is it the artist or softwares responsible for those correct models? I’d say most people who understand how software works would say software, unless they were corporate shills. Make better software, or pay the artists, the reaction shouldn’t be “artists are fooling me, they should pay”

          Taking it to an extreme. Say somehow they had this same software back in the 90s, could the generative software sue because all the images were in 256 colors? From your perspective, yes, cause it was messing up their models that are built for many more colors

    • barsoap@lemm.ee
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      4
      ·
      edit-2
      10 months ago

      “Damage to a computer” is legal logorrhoea, possible interpretations range from not even crashing a program to STUXNET, completely under-defined so it’s up to the courts to give it meaning. I’m not at all acquainted with US precedent but I very much doubt they’ll put the boundary at the very extreme of the space of interpretation, which “causes a program to expose a bug in itself without further affecting functioning in any way” indeed is.

      Which is fun because the people stealing from you face absolutely no retribution at all for their theft,

      Learning from an image, studying it, is absolutely not theft. Otherwise I shall sue you for reading this comment of mine.

      • Alien Nathan Edward@lemm.ee
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        2
        ·
        10 months ago

        Damage to a computer” is legal logorrhoea

        The model is the thing of value that is damaged.

        Learning from an image is not theft

        But making works derivative from someone else’s copyrighted image is a violation of their rights.

        • locuester@lemmy.zip
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          1
          ·
          10 months ago

          So any art done in a style of another artist is theft? Of course not. Learning from looking at others is what all of us do. It’s far more complicated than you’re making it sound.

          IMO, If the derivative that the model makes is too close to someone else’s, the person distributing such work would be at fault. Not the model itself.

          But again, it’s very nuanced. It’ll be interesting to see how it plays out in the courts.

          • Miaou@jlai.lu
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            10 months ago

            Of course not, but what does this have to do with generative models? Deep learning has as much to do with learning as democratic people’s north Korea does with democracy.

        • barsoap@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          10 months ago

          The model is the thing of value that is damaged.

          It does not get damaged, it stays as it is. Also it’s a bunch of floats, not a computer.

          But making works derivative from someone else’s copyrighted image is a violation of their rights.

          “Derivative work” doesn’t mean “inspired by”. For a work to be derivative it needs to include major copyrightable elements of the original work(s). Things such as style aren’t even copyrightable. Character design is, but then you should wonder whether you actually want to enforce that in non-commercial settings like fanart, even commissioned fanart, if e.g. Marvel doesn’t care as long as you’re not making movies or actual comics. They gain nothing from there not being, say, a Deadpool version of the Drake meme.

    • wikibot@lemmy.worldB
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      10 months ago

      Here’s the summary for the wikipedia article you mentioned in your comment:

      The Computer Fraud and Abuse Act of 1986 (CFAA) is a United States cybersecurity bill that was enacted in 1986 as an amendment to existing computer fraud law (18 U. S. C. § 1030), which had been included in the Comprehensive Crime Control Act of 1984. Prior to computer-specific criminal laws, computer crimes were prosecuted as mail and wire fraud, but the applying law was often insufficient.

      to opt out, pm me ‘optout’. article | about