Try Flow Pro free for 14 days: https://ref.wisprflow.ai/tinahuang
👉 AND get an extra month free with my code TINAHUANG

In this video I explain every way to run open source AI models! 

🤖 Want to get ahead in your career using AI? Join the waitlist for my AI Agent Bootcamp: https://www.lonelyoctopus.com/ai-agent-bootcamp

🤝 Business Inquiries: https://tally.so/r/mRDV99

🖱️Links mentioned in video
========================

🔗Affiliates
========================
My SQL for data science interviews course (10 full interviews):
https://365datascience.com/learn-sql-for-data-science-interviews/ 

365 Data Science: 
https://365datascience.pxf.io/WD0za3 (link for 57% discount for their complete data science training)

Check out StrataScratch for data science interview prep: 
https://stratascratch.com/?via=tina

🎥 My filming setup 
========================
📷 camera: https://amzn.to/3LHbi7N
🎤 mic: https://amzn.to/3LqoFJb
🔭 tripod: https://amzn.to/3DkjGHe
💡 lights: https://amzn.to/3LmOhqk

⏰Timestamps
========================
00:00 Intro
01:40 Run Open Source Models Locally 
07:47 Browser/Hosted Playgrounds 
10:44 Managed Inference API
11:57 VPS (Virtual Private Server)
15:20 Managed Cloud
16:01 On-device/Edge

📲Socials 
========================
instagram: https://www.instagram.com/hellotinah/
linkedin: https://www.linkedin.com/in/tinaw-h/ 
tiktok: https://www.tiktok.com/@hellotinahuang 
discord: https://discord.gg/5mMAtprshX

🎥Other videos you might be interested in
========================
How I consistently study with a full time job:
https://www.youtube.com/watch?v=INymz5VwLmk

How I would learn to code (if I could start over): 
https://www.youtube.com/watch?v=MHPGeQD8TvI&t=84s

🐈‍⬛🐈‍⬛About me 
========================
Hi, my name is Tina and I'm an ex-Meta data scientist turned internet person! 

📧Contact
========================
youtube: youtube comments are by far the best way to get a response from me! 
linkedin: https://www.linkedin.com/in/tinaw-h/ 
email for business inquiries only: tina@smoothmedia.co

========================
Some links are affiliate links and I may receive a small portion of sales price at no cost to you. I really appreciate your support in helping improve this channel! :)

YouTube

A comprehensive overview of every major way to run open source AI models, organized into four main categories ranked by difficulty: local (using tools like Ollama, calling APIs via code, fine-tuning), browser/hosted playgrounds (arena.ai, Groq, Hugging Face Spaces, Google Colab), managed inference APIs (Groq, Together AI, Fireworks AI), and VPS hosting (Hetzner, Hostinger with optional GPU rental via RunPod or Vast.AI). Two bonus advanced categories are also covered: managed cloud solutions for scalable enterprise deployments, and on-device/edge AI for mobile and desktop applications. Each category includes hardware requirements, use cases, pros/cons, and recommended tools.

Every Way To Run Open Source AI Models