Mathieu Comandon on Nostr: Trying to get whisper and ollama to run on my RX5700XT. All I get are either crashes ...
Trying to get whisper and ollama to run on my RX5700XT. All I get are either crashes or fallback on the CPU.
I have both working on my RX7800XT, also running on Nobara 39.
I've tried with HSA_OVERRIDE_GFX_VERSION=10.3.0 and different Pytorch + Rocm versions and no dice.
Any advice welcome!
#llama #amd #opencl #ai #linux
Published at
2024-04-19 22:56:23Event JSON
{
"id": "304e62fa12705b57c23f0f5b13550544ca1c5b26db7067279076d210c6ec080b",
"pubkey": "2da8760238ee802a1bf9f163164e2124b0daf141372ecaaa6c119244433270d9",
"created_at": 1713567383,
"kind": 1,
"tags": [
[
"t",
"llama"
],
[
"t",
"amd"
],
[
"t",
"opencl"
],
[
"t",
"ai"
],
[
"t",
"linux"
],
[
"proxy",
"https://fosstodon.org/users/mathieucomandon/statuses/112300352019529442",
"activitypub"
]
],
"content": "Trying to get whisper and ollama to run on my RX5700XT. All I get are either crashes or fallback on the CPU. \nI have both working on my RX7800XT, also running on Nobara 39.\nI've tried with HSA_OVERRIDE_GFX_VERSION=10.3.0 and different Pytorch + Rocm versions and no dice. \nAny advice welcome!\n\n#llama #amd #opencl #ai #linux",
"sig": "62e6ebe0e0d9552916a6300a65fa2b2d780e953d26174e211b22647e7d3395fb77c9ecac6a36d1d90344c31b0cd60c859bde54b4dabb4a5dd7a598b4c68a5aac"
}
