3 years ago

#truthfulqa #efficientnet #laion400M

Your regularly irregular updates on what's happening in the Machine Learning world.

OUTLINE:
0:00 - Intro
0:20 - TruthfulQA benchmark shines new light on GPT-3
2:00 - LAION-400M image-text-pair dataset
4:10 - GoogleAI's EfficientNetV2 and CoAtNet
6:15 - Uber's H3: A hexagonal coordinate system
7:40 - AWS NeurIPS 2021 DeepRacer Challenge
8:15 - Helpful Libraries
9:20 - State of PyTorch in September 2021
10:05 - Physics-Based Deep Learning Book
10:35 - Music-conditioned 3D dance generation
11:40 - Stallman's take on legal issues with Codex
12:20 - Tensorflow DirectML on AMD GPUs
13:00 - Schmidhuber Blog: Turing Oversold

ERRATA:
Uber's H3 is actually not new, but from 2018

References:
TruthfulQA - A benchmark assessing truthfulness of language models
https://owainevans.github.io/pdfs/tru...

LAION-400M image-text-pair dataset
https://laion.ai/laion-400-open-dataset/
https://laion.ai/#top
https://gogetfunding.com/help-us-buil...
https://rom1504.github.io/clip-retrie...

GooleAI releases EfficientNetV2 and CoAtNet
https://ai.googleblog.com/2021/09/tow...

Uber's H3 hexagonal coordinate systems
https://eng.uber.com/h3/?utm_source=p...

NeurIPS 2021 DeepRacer Challenge
https://www.aicrowd.com/challenges/ne...
https://aws.amazon.com/deepracer/
https://gitlab.aicrowd.com/deepracer/...

Helpful Libraries
https://github.com/rom1504/img2dataset
https://github.com/facebookresearch/v...
https://github.com/pyg-team/pytorch_g...
https://aws.amazon.com/blogs/machine-...

State of PyTorch in September 2021
https://dev-discuss.pytorch.org/t/sta...

Physics-Based Deep Learning Book
http://physicsbaseddeeplearning.org/i...
https://arxiv.org/pdf/2109.05237.pdf

Music Conditioned 3D dance generation
https://ai.googleblog.com/2021/09/mus...

Richard Stallman on Codex legal issues
https://news.slashdot.org/story/21/09...

Tensorflow DirectML on AMD
https://wccftech.com/amd-microsoft-br...

Schmidhuber: Turing Oversold
https://people.idsia.ch//~juergen/tur...

Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF
BitChute: https://www.bitchute.com/channel/yann...
Minds: https://www.minds.com/ykilcher
Parler: https://parler.com/profile/YannicKilcher
LinkedIn: https://www.linkedin.com/in/ykilcher
BiliBili: https://space.bilibili.com/1824646584

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n

Loading comments...