Semantic Chunking for RAG
Semantic chunking for RAG allows us to build more concise chunks for our RAG pipelines, chatbots, and AI agents. We can pair this with various LLMs and embedding models from OpenAI, Cohere, Anthropic, etc, and libraries like LangChain or CrewAI to build potentially improved Retrieval Augmented Generation (RAG) pipelines.
🌲 Subscribe for Latest Articles and Videos:
https://www.pinecone.io/newsletter-signup/
👋🏼 AI Consulting:
https://aurelio.ai
👾 Discord:
https://discord.gg/c5QtDB9RAP
Twitter: https://twitter.com/jamescalam
LinkedIn: https://www.linkedin.com/in/jamescalam/
00:00 Semantic Chunking for RAG
00:45 What is Semantic Chunking
03:31 Semantic Chunking in Python
12:17 Adding Context to Chunks
13:41 Providing LLMs with More Context
18:11 Indexing our Chunks
20:27 Creating Chunks for the LLM
27:18 Querying for Chunks
#artificialintelligence #ai #nlp #chatbot #openai
-
13:17
Stephen Gardner
2 hours ago🔴BREAKING: Biden SHOCKS DNC + Trump Lawyer gets NIGHTMARE NEWS!
23.5K85 -
LIVE
GameLeap RAID Shadow Legends
1 hour agoFINAL CVC PUSH! Building a NEW HYDRA KILLER and F2P Update! - Raid Shadow Legends
202 watching -
LIVE
PudgeTV
7 hours ago🟠 God of War 2018 | A New Life w Kratos and Atreus Ep 009
433 watching -
1:00:05
Grant Stinchfield
2 hours ago $3.88 earnedBreaking: Trump Could Win PA in a Big Way! Here's Why...
13.1K5 -
1:59:31
The Charlie Kirk Show
2 hours agoThe Left's Desperate October Surprise? + What Early Voting Tells Us | Kash Patel, Beck | 10.23.24
55.8K44 -
1:01:38
The Dan Bongino Show
5 hours agoIt's So Bad, They Want Biden Back (Ep. 2356) - 10/23/2024
586K3.7K -
1:06:00
The Rubin Report
4 hours agoCrowd Stunned by Tulsi Gabbard’s Scathing Remarks During Her Shock Announcement
71K97 -
1:12:07
Benny Johnson
3 hours ago🚨Kamala QUITS Campaign For SECOND DAY! Obama in PANIC as Joe Biden Calls to JAIL Trump | LANDSLIDE?
92K264 -
35:39
Tudor Dixon
3 hours ago $1.91 earnedThe Future of American Politics with Dave Rubin | The Tudor Dixon Podcast
18.3K5 -
LIVE
Midnight's Edge
3 hours agoElon sued by Blade Runner producers, Lionsgate in panic | MEiTM #630
257 watching