turkishdelight@lemmy.ml to

LocalLLaMA@sh.itjust.worksEnglish · 6 months ago

Ollama now supports AMD graphics cards

4

76

Ollama now supports AMD graphics cards

turkishdelight@lemmy.ml to

LocalLLaMA@sh.itjust.worksEnglish · 6 months ago

4

Ollama now supports AMD graphics cards · Ollama Blog

Ollama now supports AMD graphics cards in preview on Windows and Linux. All the features of Ollama can now be accelerated by AMD graphics cards on Ollama for Linux and Windows.

But in all fairness, it’s really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

Chat

Alex@lemmy.ml
link
fedilink
English
arrow-up
1·
6 months ago
I was sadly stymied by the fact the rocm driver install is very much x86 only.
- turkishdelight@lemmy.mlOP
  link
  fedilink
  English
  arrow-up
  2·
  6 months ago
  It’s improving very fast. Give it a little time.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

2 users / day
47 users / week
54 users / month
540 users / 6 months
1 local subscriber
2.21K subscribers
218 Posts
751 Comments
Modlog