turkishdelight to

LocalLLaMA@sh.itjust.worksEnglish · 3 months ago

Ollama now supports AMD graphics cards

4

cross-posted to:
aicompanions@lemmy.world

72

Ollama now supports AMD graphics cards

turkishdelight to

LocalLLaMA@sh.itjust.worksEnglish · 3 months ago

4

cross-posted to:
aicompanions@lemmy.world

Ollama now supports AMD graphics cards · Ollama Blog

Ollama now supports AMD graphics cards in preview on Windows and Linux. All the features of Ollama can now be accelerated by AMD graphics cards on Ollama for Linux and Windows.

But in all fairness, it’s really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

Chat

Alex
link
fedilink
English
arrow-up
1·
3 months ago
I was sadly stymied by the fact the rocm driver install is very much x86 only.
- turkishdelightOP
  link
  fedilink
  English
  arrow-up
  2·
  3 months ago
  It’s improving very fast. Give it a little time.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
50 users / week
130 users / month
703 users / 6 months
114 local subscribers
2.06K subscribers
206 Posts
769 Comments
Modlog