Run ANY LLM Using Cloud GPU and TextGen WebUI (aka OobaBooga)
In this video, I’ll show you how to use RunPod.io to quickly and inexpensively spin up top-of-the-line GPUs so you can run any large language model. It’s super easy, and you can run even the largest models such as Guanaco 65b. This also includes a tutorial on Text Generation WebUI (aka OobaBooga), which is like Automatic1111 but for LLMs. Basically, an open-source interface for your LLM.
Enjoy 🙂
Follow me on Twitter 🧠 – https://twitter.com/matthewberman
Subscribe to my Substack 🗞️ – https://matthewberman.substack.com
Become a Patron 🔥 – https://patreon.com/MatthewBerman
Join the Discord 💬 – https://discord.gg/xxysSXBxFW
Links:
Runpod – https://runpod.io?ref=54s0k2f8
Runpod The Bloke Template – https://runpod.io/gsc?template=qk29nkmbfr&ref=54s0k2f8
HuggingFace – https://www.huggingface.co
Guanaco Model – https://huggingface.co/TheBloke/guanaco-65B-GPTQ
TextGen WebUI – https://github.com/oobabooga/text-generation-webui
Comments are closed.