AMD GPU Linux bitsandbytes installation – step by step guide for 8-bit functions
Bitsandbytes use quantitizations to save VRAM so you can run larger models ๐โขโคโโขโโกโโโ Thank you for watching! please consider to subscribe. thank you!
For Linux Ubuntu install, please see https://youtu.be/2H321xb2jA8
For Linux ROCm install, see https://youtu.be/coGVsROvMC4
The AMD GPU model is 6700XT. Should work for other 6000 series AMD GPUs.
The repo url is: https://git.ecker.tech/mrq/bitsandbytes-rocm
Please join the discord server at https://discord.gg/SgmBydQ2Mn where you can ask questions and also try out my recently developed free chatgpt bot and stable diffusion bot!
If you would like to support me, here is my Kofi link: https://ko-fi.com/techpractice and Patreon page: https://www.patreon.com/user?u=89548519
Thank you for watching!