Signs of undeclared ChatGPT use in papers mounting - eviltoast
  • henfredemars@infosec.pub
    link
    fedilink
    English
    arrow-up
    27
    ·
    1 year ago

    I’ve heard many papers are published to never be read by humans. It only makes sense that some portion of those papers aren’t written by humans either.

    I wonder what the overlap is between AI assisted papers and papers with few to no readers.

    • PoisonedPrisonPanda@discuss.tchncs.de
      link
      fedilink
      arrow-up
      26
      arrow-down
      2
      ·
      edit-2
      1 year ago

      The whole system should get ready for the 21st century.

      Most of the scientists arent great writers. It does not make sense to still force them to be a good writer.

      Let be fishes be good at swimming instead of climbing trees.

      In a modern world where basically EVERYTHING is specialized and no generalist is alive anymore we should make use of language tools.

      Hell Chatgpt writes an introduction which is fun to read instead or my overcomplicated bullshit that I would have brought up

      Edit: the comment was not related to the OP but to a general chatgpt discussion.

      • henfredemars@infosec.pub
        link
        fedilink
        English
        arrow-up
        8
        ·
        edit-2
        1 year ago

        It’s interesting that you write this because the last place I worked focused on unspecializing by having almost everyone do every job.

        In fact, they relocated across the country to save on building costs, and instead of hiring actual technical writers and office staff, they pushed the extra work down on their engineers because it’s more profitable to bill for the engineering time.

        I spent much of my job editing papers and I’m not even good at it while getting paid to do embedded design. It was weird. It was basically fraud but walking the fine line of technically legal.

        I observed this happening multiple times throughout my career. Sometimes, inefficiency is the point in this case driven by capitalists and market forces.

      • sab@kbin.social
        link
        fedilink
        arrow-up
        13
        arrow-down
        5
        ·
        1 year ago

        One important thing is that you have potential. ChatGDP will write something alright-ish, but it’s literally impossible for it to move beyond that. It doesn’t have the power of creativity.

        Writing is painful, but it also helps us think clearer about our work and contribution. I think it’s an important part of the process of doing science, no matter which field. And one gets better at it with training.

        • PoisonedPrisonPanda@discuss.tchncs.de
          link
          fedilink
          arrow-up
          3
          arrow-down
          1
          ·
          1 year ago

          I dont need it to be beyond that? It does what I told it. And if I am creative enough to get my preferred output its great. I have still to decide if Ill use it.

          Its a tool which can be used by people and helps with work.

          I think it’s an important part of the process of doing science, no matter which field. And one gets better at it with training

          Sorry but this expression is probably a similar one when paper writting shifted to digital only format or when the typewriter was introduced.

          Boomer tell me the same with printed paper. “oNlY whEn ItS PriNtED yOu cAn rEaD pRoberly”

          Thats bullshit its just fear of the something new and convenience of routine.

          Nothing personal against you. I welcome any tool that helps me.

          • bane_killgrind@lemmy.ml
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            So I’m not sure it’s helping you.

            You would refrain from doing the work of organizing the concept in your head into a clearly communicable explanation of the concept.

            • PoisonedPrisonPanda@discuss.tchncs.de
              link
              fedilink
              arrow-up
              1
              ·
              1 year ago

              I think of it as in another anology.

              Compare a screwdriver with a power tool.

              Does the convenient solution hinder you from building your house simply because you cant “feel” the strength of the wood while turning the screw in?

              i doubt.

              The things you mentioned are coming into play when people think of AI as a god mode. As a user you are solely responsible for how to use a tool. If the user overestimates the power of the tool or use it for the wrong things. Its the users fault.

              The scientist is still a scientist. Which is the author of the paper. Not gpt because it writes filler text or puts the scientists thoughts into sentences.

              The context is still at the scientists plate. If the scientist does a poorly job at reviewing the gpts output. Gpt cant be faulted.

              • bane_killgrind@lemmy.ml
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 year ago

                A research paper is not bulk work like a house. It’s more like a watch, and a watchmaker using a screw gun is daft.

                • PoisonedPrisonPanda@discuss.tchncs.de
                  link
                  fedilink
                  arrow-up
                  1
                  ·
                  1 year ago

                  Thats another point. Fair enough.

                  But still I dont think that science will stall just because of chatgpt.

                  Journalism? Will for sure. But scientific publications have a systemic problem (like publisher-polism, pubscores etc) And outsourcing writing work to chargpt is - in my opinion - non of them.

          • Vilian@lemmy.ca
            link
            fedilink
            arrow-up
            7
            ·
            1 year ago

            a test for creativity seriously that work? also after scraping the entire of internet of course someone could think that, ask any programmer and they gonna explain that the IA don’t create anything, it can’t even do basic msth because it don’t gave logic in that,maybe one day, but not with chatgpt of today

            • FaceDeer@kbin.social
              link
              fedilink
              arrow-up
              2
              ·
              1 year ago

              Yes, a test for creativity. If you’re going to say something “doesn’t have the power of creativity” then it behooves you to accept the notion that creativity is measurable.

            • boredazfcuk@mastodon.social
              link
              fedilink
              arrow-up
              0
              ·
              1 year ago

              @Vilian @FaceDeer I agree. I’m no programmer but do a fair bit of Linux/powershell/bash scripting. Virtually all the code that ChatGPT gives me is wrong. You tell it the errors, and it gives you a modified script with errors, point out those errors and it’s go back to its first answer. The only thing it is useful for is writing lots of basic code, really quickly. I can just copy/paste then start debugging.

              • FaceDeer@kbin.social
                link
                fedilink
                arrow-up
                2
                ·
                1 year ago

                I am a programmer and I’ve found ChatGPT to be able to produce plenty of good, useful code. I haven’t encountered the problems you’re describing in correcting its errors, perhaps you’re not prompting it well.

            • sab@kbin.social
              link
              fedilink
              arrow-up
              1
              arrow-down
              2
              ·
              1 year ago

              This is the key - it does not create, it can only copy. Which is good enough to fool us - there’s enough stuff to copy out there that you can spend your whole life copying other people and nobody will ever notice you’re not actually creating anything new. What’s more, you’ll probably come across as pretty clever. But you’re not creating anything new.

              For me, this poses an existential threat to academia. It might halt development in the field without researchers even noticing: Their words look fine, as if they had thought it through, and they of course read it to make sure it’s logically consistent. However, the creative force is gone. Nothing new will come under the sun - the kind of new thoughts that can only be made by creative humans thinking new thoughts that have never been put on paper before.

              If we give up that, what’s even the point of doing science in the first place.

              • Sinnerman@kbin.social
                link
                fedilink
                arrow-up
                1
                ·
                1 year ago

                There’s a difference between:

                1. Using ChatGPT to help write parts of the text in the same way you’d use a grammar- or spell-checker (e.g. if English isn’t your first language) after you’ve finished the experiments

                2. Using ChatGPT to write a paper without even doing any experiments

                Clearly the second is academic misconduct. The first one is a lot more defensible.

                • sab@kbin.social
                  link
                  fedilink
                  arrow-up
                  3
                  arrow-down
                  2
                  ·
                  1 year ago

                  Yes, absolutely. But I still think it has its dangers.

                  Using it to write the introduction doesn’t change the substance of the paper, yet it does provide the framework for how the reader interprets it, and also often decides whether it’ll be read at all.

                  Maybe worse, I find that it’s oftem in the painful writing and rewriting of the introduction and conclusion that I truly understand my own contribution - I’ve done the analysis and all that, but in forcing myself to think about the relevance for the field and the reader I also bring myself to better understand what the paper means in a deeper sense. I believe this kind of deep thinking at the end of the process is incredibly valuable, and it’s what I’m afraid we might be losing with AI.

              • FaceDeer@kbin.social
                link
                fedilink
                arrow-up
                1
                ·
                1 year ago

                This is the key - it does not create, it can only copy.

                I have asked ChatGPT to write poetry on subjects that I know with great certainty have never had poems written about them.

                You can of course shuffle around the meanings of “create” and “copy” to try to accommodate that, but eventually you end up with a “copying” process that’s so flexible and malleable that it might as well be creativity. It’s not like what comes out of human brains isn’t based on stuff that went into them earlier either.

      • stockRot@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        1 year ago

        … Did you read the article? Language tools like grammarly and deepL are in use by scientists today. Copying+pasting the output of chatGPT without ever looking at it, or even using a language tool to publish thoughts that were never in your head to begin with, is the actual concern

        • PoisonedPrisonPanda@discuss.tchncs.de
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          Did you read the article?

          I for sure didnt.

          Thanks for highlighting that.

          I was carried away by having the discussions at my university with my peers in mind.

          Copying+pasting the output of chatGPT without ever looking at it, or even using a language tool to publish thoughts that were never in your head to begin with, is the actual concern

          Nevertheless I dont understand why this is a concern.

          The scientific standards existed decades if not already at least a century.

          Those discussions are putting chatgpt in a bad light. However the fact that our scientific system was eroded and made a mockery of before the introduction of chatgpt is not highlighted.

          There are still plagiarizations around and nobody cares. Mostly because of political sensitivity.

          However science has failed to repel “bad actors” (intentional or unintentional) from the scene.

          I dont know when. And why. But publisher have for sure something to do with it.

      • monobot@lemmygrad.ml
        link
        fedilink
        arrow-up
        0
        arrow-down
        1
        ·
        1 year ago

        I agree, I have no problem with people guiding chatgpt to help them write something they want and they checked it.

        Generating bunch of articles even they didn’t read is something else.

  • Ketil Froyn@mas.to
    link
    fedilink
    arrow-up
    9
    ·
    1 year ago

    @floofloof They charge €40 for access, yet one is left wondering what sort of peer review this paper has undergone when obvious signs of generative AI has slipped in. What about less obvious signs? If the “authors” had simply used the copy-to-clipboard icon in chatgpt, they would have been all good and this would never have been uncovered.

    If anything, this is an argument for free public access to scientific papers. Any experts on AI could scan and detect this, even when it’s more subtle.