LLaMA2 Local install on MacBook

Install LLaMA2 on an Apple Silicon MacBook Pro, and run some code generation.

get TG Pro for yourself: https://www.tunabellysoftware.com/tgpro/index.php?fpr=alex

👀 *More gear I use:* (including course creation and youtube stuff): https://www.amazon.com/shop/alexziskind

▶️ Apple Silicon and Developers Playlist – https://youtube.com/playlist?list=PLPwbI_iIX3aR88msMh-cHoJiBqS6YMUUH

*Repos and models*
1. Request access: https://ai.meta.com/resources/models-and-libraries/llama-downloads/
2. Clone: https://github.com/facebookresearch/llama
3. Clone: https://github.com/ggerganov/llama.cpp

*Commands*
python3 -m pip install -r requirements.txt
python3 convert.py –outfile models/7B/ggml-model-f16.bin –outtype f16 ../../llama2/meta_models/llama-2-7b-chat
make
./quantize ./models/7B/ggml-model-f16.bin ./models/7B/ggml-model-q4_0.bin q4_0
./main -m ./models/7B/ggml-model-q4_0.bin -n 1024 –repeat_penalty 1.0 –color -i -r “User:” -f ./prompts/chat-with-bob.txt

#m2pro #m2max #programming

💻NativeScript training courses — https://nativescripting.com
(Take 15% off any premium NativeScript course by using the coupon code YT2020)
👕👚iScriptNative Gear – https://nuvio.us/isn

— — — — — — — — —

❤️ SUBSCRIBE TO MY YOUTUBE CHANNEL 📺

Click here to subscribe: https://www.youtube.com/c/alexanderziskind

— — — — — — — — —

🏫 FREE COURSES

NativeScript Core Getting Started Guide (Free Course) – https://nativescripting.com/course/nativescript-core-getting-started-guide

NativeScript with Angular Getting Started Guide (Free Course) – https://nativescripting.com/course/nativescript-with-angular-getting-started-guide

Upgrading Cordova Applications to NativeScript (Free Course) – https://nativescripting.com/course/upgrading-cordova-applications-to-nativescript

— — — — — — — — —

📱LET’S CONNECT ON SOCIAL MEDIA

ALEX ON TWITTER: https://twitter.com/digitalix
NATIVESCRIPTING ON TWITTER: https://twitter.com/nativescripting