Premium Only Content
![Memory-assisted prompt editing to improve GPT-3 after deployment (Machine Learning Paper Explained)](https://1a-1791.com/video/s8/1/W/F/s/G/WFsGd.qR4e-small-Memory-assisted-prompt-edit.jpg)
Memory-assisted prompt editing to improve GPT-3 after deployment (Machine Learning Paper Explained)
#nlp #gpt3 #prompt
Large language models such as GPT-3 have enabled many breakthroughs and new applications recently, but they come with an important downside: Training them is very expensive, and even fine-tuning is often difficult. This paper presents an adaptive method to improve performance of such models after deployment, without ever changing the model itself. This is done by maintaining a memory of interactions and then dynamically adapting new prompts by augmenting them with memory content. This has many applications, from non-intrusive fine-tuning to personalization.
Sponsor: Introduction to Graph Neural Networks Course
https://www.graphneuralnets.com/p/int...
OUTLINE:
0:00 - Intro
0:40 - Sponsor: Introduction to GNNs Course (link in description)
1:30 - Paper Overview: Improve GPT-3 after deployment via user feedback
5:30 - Proposed memory-based architecture
13:00 - A detailed look at the components
15:00 - Example tasks
24:30 - My concerns with the example setup
26:20 - Baselines used for comparison
29:50 - Experimental Results
34:20 - Conclusion & Comments
Paper: https://arxiv.org/abs/2201.06009
Code & Data: https://github.com/madaan/memprompt
Abstract:
Large LMs such as GPT-3 are powerful, but can commit mistakes that are obvious to humans. For example, GPT-3 would mistakenly interpret "What word is similar to good?" to mean a homonym, while the user intended a synonym. Our goal is to effectively correct such errors via user interactions with the system but without retraining, which will be prohibitively costly. We pair GPT-3 with a growing memory of recorded cases where the model misunderstood the user's intents, along with user feedback for clarification. Such a memory allows our system to produce enhanced prompts for any new query based on the user feedback for error correction on similar cases in the past. On four tasks (two lexical tasks, two advanced ethical reasoning tasks), we show how a (simulated) user can interactively teach a deployed GPT-3, substantially increasing its accuracy over the queries with different kinds of misunderstandings by the GPT-3. Our approach is a step towards the low-cost utility enhancement for very large pre-trained LMs. All the code and data is available at this https URL.
Authors: Aman Madaan, Niket Tandon, Peter Clark, Yiming Yang
Links:
Merch: store.ykilcher.com
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yann...
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/2017636191
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
LIVE
The Jimmy Dore Show
3 hours agoJon Stewart RIPS Dems for Trump Derangement Syndrome! Corporations ABANDONING DEI! w/ Sally Morell
19,321 watching -
LIVE
Nerdrotic
6 hours ago $7.32 earnedDisney Plus's Complete FAILURE! Fantastic Four Trailer, MCU Phase 5 Reveal | Friday Night Tights 340
3,964 watching -
LIVE
Sarah Westall
2 hours ago10 Billion Trump Lawsuit against CBS 60 Minutes, Ukraine Bio-labs and more w/ John Mark Dougan
520 watching -
LIVE
LFA TV
22 hours agoThe ‘Dictator’ Who Downsizes Government | TRUMPET DAILY 2.7.25 7pm
292 watching -
LIVE
2 MIKES LIVE
2 hours ago2 MIKES LIVE #177 Open Mike Friday and DOGE ball!
279 watching -
2:02:32
Revenge of the Cis
5 hours agoEpisode 1443: True Love
34.8K2 -
1:02:53
In The Litter Box w/ Jewels & Catturd
1 day agoLOOK! SQUIRREL! | In the Litter Box w/ Jewels & Catturd – Ep. 737 – 2/7/2025
55K41 -
1:42:38
The Quartering
6 hours agoDOGE Goes Nuclear, USAID SHUTDOWN, Southern Border SECURED, Kanye West MELTDOWN & More
94.2K53 -
LIVE
Dr Disrespect
7 hours ago🔴LIVE - DR DISRESPECT - WARZONE - 10 WINS IN A ROW CHALLENGE
3,129 watching -
21:47
Film Threat
5 hours agoLIVE FROM MEGACON IN ORLANDO, FLORIDA! | Film Threat Live
46.3K