The New York Times blocks OpenAI’s web crawler - eviltoast

The New York Times blocks OpenAI’s web crawler::The New York Times has officially blocked GPTBot, OpenAI’s web crawler. The outlet’s robot.txt page specifically disallows GPTBot, preventing OpenAI from scraping content from its website to train AI models.

  • JdW@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    1 year ago

    AI consumption of news content makes the news more accessible.

    If journalists and their platforms do not get paid their articles won’t get written. So no, the free absorbtion of professional articles into a LLM that uses the article to answer a Pokemon question online in 6 months is not making “news” more “accesible”.

    • porkins@lemmy.basedcount.com
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      1 year ago

      It’s moreso an archive of historical knowledge. Thinking it just answers Pokémon questions is shortsighted.