ActInf ModelStream 011.1 ~ Hadi Vafaii: "Poisson Variational Autoencoder"
"Poisson Variational Autoencoder"
Hadi Vafaii, Dekel Galor, Jacob L. Yates
https://arxiv.org/abs/2405.14473
[Submitted on 23 May 2024]
Variational autoencoders (VAE) employ Bayesian inference to interpret sensory inputs, mirroring processes that occur in primate vision across both ventral (Higgins et al., 2021) and dorsal (Vafaii et al., 2023) pathways. Despite their success, traditional VAEs rely on continuous latent variables, which deviates sharply from the discrete nature of biological neurons. Here, we developed the Poisson VAE (P-VAE), a novel architecture that combines principles of predictive coding with a VAE that encodes inputs into discrete spike counts. Combining Poisson-distributed latent variables with predictive coding introduces a metabolic cost term in the model loss function, suggesting a relationship with sparse coding which we verify empirically. Additionally, we analyze the geometry of learned representations, contrasting the P-VAE to alternative VAE models. We find that the P-VAEencodes its inputs in relatively higher dimensions, facilitating linear separability of categories in a downstream classification task with a much better (5x) sample efficiency. Our work provides an interpretable computational framework to study brain-like sensory processing and paves the way for a deeper understanding of perception as an inferential process.
----
Active Inference Institute information:
Website: https://activeinference.org/
Twitter: https://twitter.com/InferenceActive
Discord: https://discord.gg/8VNKNp4jtx
YouTube: https://www.youtube.com/c/ActiveInference/
Active Inference Livestreams: https://coda.io/@active-inference-institute/livestreams
CSID: e9aeb713e167ab71
Content Managed by ContentSafe.co
-
LIVE
Michael Franzese
16 hours agoDemocrat Party is Evil: The Border, Cover Ups, Fraud | Michael Franzese LIVE! Ep. 19
999 watching -
12:04
Liam Reid
15 hours ago9-Year-Old 250 2 Stroke vs Modern 4 Stroke!
34 -
15:07
CartierFamily
1 day agoRepublican CALMLY DISMANTLES CNN Host Over GOP Denied Bill! 🔥
15.3K52 -
20:10
Degenerate Jay
3 hours agoThe PlayStation 5 Pro Is Bad News For Gaming
8.21K3 -
11:47
Colion Noir
16 hours agoKamala Harris Panders To Oprah Saying If Someone Breaks Into My House They Getting Shot
9.85K29 -
14:30
IsaacButterfield
1 day ago $0.03 earnedMy Girlfriend Is Trans But I’m Not Gay
6.11K14 -
5:51
Dr. Nick Zyrowski
1 day agoBerberine, Fat Loss & Your Blood Sugar | Must See!
4.04K3 -
10:23
Sideserf Cake Studio
2 hours ago2 Easy Hyperreaslitic Cakes YOU Can Make!
5.18K2 -
13:46
Tactical Advisor
1 day agoCan a Gun This Small Be Any Good? Smith & Wesson Bodyguard 2.0
4.94K4 -
59:51
Trumpet Daily
23 hours agoWhat Is Kamala Harris Trying to Say? - Trumpet Daily | Sept. 20, 2024
8.18K10