AI Jason ：The REAL cost of LLM (And How to reduce 78%+ of Cost)

I want to give you step by step guide on how to reduce LLM cost by 70%, and unpack why it is costing so much now

Free HubSpot AI For Marketers Course: https://academy.hubspot.com/courses/AI-for-Marketers?utm_source=youtube&utm_medium=social&utm_campaign=CR00174Jan2024_AIJason%2Fpartner_youtube

🔗 Links
– Follow me on twitter: https://twitter.com/jasonzhou1993
– Join my AI email list: https://crafters.ai/
– My discord: https://discord.gg/eZXprSaCDE
– Inbox Agent: https://www.youtube.com/watch?v=Jv_e6Rt4vWE&t=23s&ab_channel=AIJason
– Research Agent: https://www.youtube.com/watch?v=ogQUlS7CkYA&t=299s&ab_channel=AIJason
– James Brigg on Agent Memory: https://www.pinecone.io/learn/series/langchain/langchain-conversational-memory/

⏱️ Timestamps
0:00 How I burned $5000 on OpenAI
2:41 My experience with AI Girlfriend Project
6:01 HubSpot AI For Markter
7:23 How to Reduce LLM Cost
8:33 Method 1 – Finetune
9:51 Method 2 – Cascade
10:35 Method 3 – LLM Router
12:47 Method 4 – Multi-Agent
14:07 Method 5 – LLMLingua
16:31 Method 6 – Optimise tool input/output
17:16 Method 7 – Memory Optimisation
19:26 LLM Monitor & Analytics
20:09 Tutorial: Monitor & reduce 75% cost

👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! [email protected]

#mixtral #gpt4turbo #gpt4 #ai #artificialintelligence #tutorial #stepbystep #openai #llm #chatgpt #largelanguagemodels #largelanguagemodel #bestaiagent #chatgpt #agentgpt #agent #autogen #autogpt