NVIDIA’s new AI chatbot runs locally on your PC - eviltoast

• NVIDIA released a demo version of a chatbot that runs locally on your PC, giving it access to your files and documents.

• The chatbot, called Chat with RTX, can answer queries and create summaries based on personal data fed into it.

• It supports various file formats and can integrate YouTube videos for contextual queries, making it useful for data research and analysis.

  • anlumo@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    9 months ago

    On my 4090, the performance is much better than ChatGPT4. The output is way worse though.

    • Scott@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      9 months ago

      Yeah my boss did a screen share with me and it was done instantly, while mine was needing to recompile the embeddings for the 5th time