But in all fairness, it’s really llama.cpp that supports AMD.

Now looking forward to the Vulkan support!

  • Alex
    link
    fedilink
    English
    arrow-up
    3
    ·
    3 months ago

    That’s cool. I’ve just recently gotten hold of an interesting Ampere system and it’s got an AMD card in it. I must give it a spin.

    • Alex
      link
      fedilink
      English
      arrow-up
      1
      ·
      3 months ago

      I was sadly stymied by the fact the rocm driver install is very much x86 only.