a devlog on machines & languages

8 AMD ROCm 10

AMD has bumped the version of its ROCm SDK from 7.2.4 to 10.0. I have a 9070 XT. I previously had a 6700 XT. The Vulkan and ROCm interfaces behave differently enough to be a constant irritant.

Vulkan is easy to use with llama.cpp. Other LLM tooling often requires ROCm.

pp is higher in ROCm than Vulkan. The reverse is the case with tg.1

  1. Performance of llama.cpp with Vulkan #10879