Premium Only Content

How to run a self hosted AI
An overview of an open source, self hosted A.I. system. We'll see how to set it up, how to run it (with the CPU only), and an example interaction.
We'll also see how Python scripts that interface with these systems look like.
For this video we'll look at text generative A.I. models only.
A.I.:
- FastChat: https://github.com/lm-sys/FastChat
A.I. Models:
- FastChat-T5: https://huggingface.co/lmsys/fastchat-t5-3b-v1.0
- RedPajama-INCITE-Chat-3B-v1: https://huggingface.co/togethercomputer/RedPajama-INCITE-Chat-3B-v1
O.S.:
- Debian: https://www.debian.org/download
CHAPTERS
0:00 Intro
0:59 Virtual machine settings
1:29 Debian as OS of choice
1:48 PIP installation
2:00 FastChat installation through PIP
2:12 The FastChat-T5 model
2:26 First part of interaction with FastChat-T5
4:41 Real speed, processor and memory usage
6:12 Clone GIT repositories of the models and datasets
6:26 Second part of interaction with FastChat-T5
9:06 Bonus coding question
9:19 Testing another model using a Python script instead of interacting with the CLI directly
10:22 Outtro
#ai #generativeai #selfhostedai #fastchat #debian
-
5:08
Gun Owners Of America
16 hours agoDebunking Everytown's False Claims About Us
6191 -
1:00:59
Trumpet Daily
19 hours ago $3.33 earnedTrump Unites the World Against America - Trumpet Daily | Apr. 3, 2025
2.58K1 -
4:13:56
Alex Zedra
10 hours agoLIVE! VERDANSK!!!!!
75.8K10 -
16:38
T-SPLY
16 hours agoDemocrats Are At President Trump For "Liberation Day"
47.5K43 -
LIVE
SpartakusLIVE
19 hours ago24 HOUR STREAM w/ The MACHINE on Verdansk
1,064 watching -
4:34:57
SoundBoardLord
11 hours agoR.E.P.O. Thriller Thursday with Friends!! ROUND 2
46.1K3 -
2:08:13
BrancoFXDC
8 hours ago $9.21 earnedBack to VERDANSK We Go!
49.9K -
5:03:10
Pepkilla
12 hours agoTime to Party Verdansk
35.9K5 -
4:55:48
iCheapshot
10 hours ago $8.70 earnedWhere We Landing Boys! | Warzone Verdansk is Back Yeerrr
76.4K6 -
1:11:15
Savanah Hernandez
12 hours agoIt’s Time To Start Asking Hard Questions: Where Are The Arrests?
78.5K220