Premium Only Content

How to run a self hosted AI
An overview of an open source, self hosted A.I. system. We'll see how to set it up, how to run it (with the CPU only), and an example interaction.
We'll also see how Python scripts that interface with these systems look like.
For this video we'll look at text generative A.I. models only.
A.I.:
- FastChat: https://github.com/lm-sys/FastChat
A.I. Models:
- FastChat-T5: https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
- RedPajama-INCITE-Chat-3B-v1: https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1
O.S.:
- Debian: https://www.debian.org/download
CHAPTERS
0:00 Intro
0:59 Virtual machine settings
1:29 Debian as OS of choice
1:48 PIP installation
2:00 FastChat installation through PIP
2:12 The FastChat-T5 model
2:26 First part of interaction with FastChat-T5
4:41 Real speed, processor and memory usage
6:12 Clone GIT repositories of the models and datasets
6:26 Second part of interaction with FastChat-T5
9:06 Bonus coding question
9:19 Testing another model using a Python script instead of interacting with the CLI directly
10:22 Outtro
#ai #generativeai #selfhostedai #fastchat #debian
-
LIVE
Sean Unpaved
1 hour agoNFL Draft Deep Dive: First-Round Movers & Stars to Watch
969 watching -
LIVE
Ben Shapiro
1 hour agoEp. 2185 - My Journey To Ukraine and My Interview With Zelensky
1,327 watching -
LIVE
The Dilley Show
1 hour agoTrump Oval Office, 100 Days Rally and More! w/Author Brenden Dilley 04/24/2025
2,686 watching -
1:01:59
Timcast
1 hour agoKyiv ATTACKED, Trump Tells Putin “STOP,” Slams Zelenskyy For REFUSING Peace Ft Sebastian Gorka
36.6K41 -
2:10:03
Steven Crowder
3 hours ago🔴 Trump Lays Down the Law on Ukraine & Russia: Take the Deal or We Walk
200K99 -
LIVE
Nerdrotic
3 hours agoNerdrotic Nooner 481
878 watching -
LIVE
The Tom Renz Show
36 minutes agoDeep State, MAHA and MAGA
138 watching -
LIVE
TheAlecLaceShow
2 hours agoGuests: Frank Pavone & Clay Clark | 5K For New Moms | Trade Job Initiative | The Alec Lace Show
74 watching -
LIVE
The Charlie Kirk Show
1 hour ago"Disparate Impact" Must Die + "Maryland Dad" Human Smuggling | Hassett, Hilton, Dr. Slack | 4.24.25
4,291 watching -
LIVE
Flyover Conservatives
12 hours agoExposing the Left’s Agenda: Border Chaos, Gun Control, and 2028 Predictions - Nick Adams | FOC Show
307 watching