Running on AMD gpu on Windows without installing the full SDK #194
DGdev91
started this conversation in
Show and tell
Replies: 1 comment
-
Bless you! I was getting realy skill issued trying to get my ROCm build to link properly to the SDK, and this solved it for me, though things have changed a bit since you started that discussion. I couldn't find |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
The ROCm version of KoboldCpp (https://github.com/YellowRoseCx/koboldcpp-rocm) copies it's runtime libs in a temporary folder called "_MEI" + some nubers, placed in C:\Users\username\AppData\Local\Temp. In those libs there are also hipblas.dll, rocblas.dll, and a "library" folder containing ROCm's tensile library files, and this allows it to run on amd gpus without the need of having the SDK installed.
I just checked, and this works just fine for stablediffussion.cpp too. just copy those libs from koboldcpp's temp folder and place it in the same place as sd.exe
Maybe i can also be a good idea shipping those libs in the rocm windows build
Beta Was this translation helpful? Give feedback.
All reactions