Premium Only Content
![Memory-assisted prompt editing to improve GPT-3 after deployment (Machine Learning Paper Explained)](https://1a-1791.com/video/s8/1/W/F/s/G/WFsGd.qR4e-small-Memory-assisted-prompt-edit.jpg)
Memory-assisted prompt editing to improve GPT-3 after deployment (Machine Learning Paper Explained)
#nlp #gpt3 #prompt
Large language models such as GPT-3 have enabled many breakthroughs and new applications recently, but they come with an important downside: Training them is very expensive, and even fine-tuning is often difficult. This paper presents an adaptive method to improve performance of such models after deployment, without ever changing the model itself. This is done by maintaining a memory of interactions and then dynamically adapting new prompts by augmenting them with memory content. This has many applications, from non-intrusive fine-tuning to personalization.
Sponsor: Introduction to Graph Neural Networks Course
https://www.graphneuralnets.com/p/int...
OUTLINE:
0:00 - Intro
0:40 - Sponsor: Introduction to GNNs Course (link in description)
1:30 - Paper Overview: Improve GPT-3 after deployment via user feedback
5:30 - Proposed memory-based architecture
13:00 - A detailed look at the components
15:00 - Example tasks
24:30 - My concerns with the example setup
26:20 - Baselines used for comparison
29:50 - Experimental Results
34:20 - Conclusion & Comments
Paper: https://arxiv.org/abs/2201.06009
Code & Data: https://github.com/madaan/memprompt
Abstract:
Large LMs such as GPT-3 are powerful, but can commit mistakes that are obvious to humans. For example, GPT-3 would mistakenly interpret "What word is similar to good?" to mean a homonym, while the user intended a synonym. Our goal is to effectively correct such errors via user interactions with the system but without retraining, which will be prohibitively costly. We pair GPT-3 with a growing memory of recorded cases where the model misunderstood the user's intents, along with user feedback for clarification. Such a memory allows our system to produce enhanced prompts for any new query based on the user feedback for error correction on similar cases in the past. On four tasks (two lexical tasks, two advanced ethical reasoning tasks), we show how a (simulated) user can interactively teach a deployed GPT-3, substantially increasing its accuracy over the queries with different kinds of misunderstandings by the GPT-3. Our approach is a step towards the low-cost utility enhancement for very large pre-trained LMs. All the code and data is available at this https URL.
Authors: Aman Madaan, Niket Tandon, Peter Clark, Yiming Yang
Links:
Merch: store.ykilcher.com
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yann...
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/2017636191
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
-
13:31:32
iViperKing
17 hours agoGood Times + Good Energy Ft. Whez.. #VKGFAM #RRR
70K15 -
12:24
Winston Marshall
1 day agoWOAH! Bannon just Revealed THIS About MUSK - The Tech-Right vs MAGA Right Civil War Ramps Up
196K287 -
7:33:46
Phyxicx
16 hours agoRaid & Rant with the FF14 Guild on Rumble! Halo Night just wrapped up! - Go Follow all these great guys please! - 2/15/2025
134K3 -
10:42:19
Reolock
18 hours agoWoW Classic Hardcore (LVL 60) | RAID DAY | Rumble FIRST HC Raid
84.5K4 -
3:10:03
Barry Cunningham
15 hours agoTRUMP WEEKEND BRIEFING! MORE WINNING...MORE LEFTIES LOSING IT!
63.3K37 -
2:20:09
Tundra Tactical
15 hours ago $3.09 earnedIs Trumps Executive Order A Second Amendment Wishlist???: The Worlds Okayest Gun Live Stream
43.3K2 -
2:33:51
John Crump Live
20 hours ago $27.37 earnedSaturday Night Main Event!
140K13 -
13:57
TimcastIRL
1 day agoTrump NUKES IRS After DOGE Investigation, OVER 9000 Employees To Be FIRED
145K185 -
13:35
Russell Brand
18 hours agoPFIZER JUST MADE THEIR NEXT MOVE AND EXPERTS ARE TERRIFIED
168K335 -
1:15:57
Victor Davis Hanson Show
1 day agoOver Here, Over There: the Russo-Japanese War and Trumpian Peace Policy
81.7K35