[ML News] DeepMind builds Gopher | Google builds GLaM | Suicide capsule uses AI to check access

#mlnews #gopher #glam

Your updates on everything going on in the Machine Learning world.

Sponsor: Weights & Biases
https://wandb.me/yannic

OUTLINE:
0:00 - Intro & Overview
0:20 - Sponsor: Weights & Biases
3:05 - DeepMind releases 3 papers on large language models
11:45 - Hugging Face Blog: Training CodeParrot from scratch
14:25 - Paper: Pre-Training vision systems with noise
15:45 - DeepMind advances Quantum Mechanics
16:45 - GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model
18:45 - Colin Raffel calls for building ML models like we build Open-Source software
22:05 - A rebuke of the hype around DeepMind's math paper
24:45 - Helpful Things
32:25 - Suicide Capsule plans AI to assess your mental state before use
35:15 - Synthesia raises 50M to develop AI avatars

Weights & Biases Embedding Projector
https://twitter.com/_ScottCondron/sta...
https://docs.wandb.ai/ref/app/feature...
https://wandb.ai/timssweeney/toy_data...

DeepMind releases 3 papers on large language models
https://deepmind.com/blog/article/lan...
https://arxiv.org/pdf/2112.04426.pdf
https://kstatic.googleusercontent.com...
https://arxiv.org/pdf/2112.04359.pdf
https://deepmind.com/research/publica...

Hugging Face Blog: Training CodeParrot from scratch
https://huggingface.co/blog/codeparro...

Paper: Pre-Training vision systems with noise
https://mbaradad.github.io/learning_w...

DeepMind advances Quantum Mechanics
https://deepmind.com/blog/article/Sim...
https://storage.googleapis.com/deepmi...
https://github.com/deepmind/deepmind-...

GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model
https://ai.googleblog.com/2021/12/mor...

Colin Raffel calls for building ML models like we build Open-Source software
https://colinraffel.com/blog/a-call-t...

A rebuke of the hype around DeepMind's math paper
https://arxiv.org/abs/2112.04324?s=09

Helpful Things
https://twitter.com/huggingface/statu...
https://docs.cohere.ai/prompt-enginee...
https://github.blog/2021-12-08-improv...
https://huggingface.co/blog/data-meas...
https://huggingface.co/spaces/hugging...
https://blogs.microsoft.com/ai-for-bu...
https://techcommunity.microsoft.com/t...
https://github.com/minitorch/minitorc...
https://minitorch.github.io/
https://pandastutor.com/
https://pandastutor.com/vis.html
https://github.com/IAmPara0x/yuno
https://colab.research.google.com/dri...
https://www.reddit.com/r/MachineLearn...
https://www.drivendata.org/competitio...
https://www.reddit.com/r/MachineLearn...
https://www.uttt.ai/
https://arxiv.org/abs/2112.02721?utm_...
https://arxiv.org/pdf/2112.02721.pdf
https://github.com/GEM-benchmark/NL-A...
https://www.reddit.com/r/MachineLearn...

Suicide Capsule plans AI to assess your mental state before use
https://www.swissinfo.ch/eng/sci-tech...

Synthesia raises 50M to develop AI avatars
https://techcrunch.com/2021/12/08/syn...
https://www.synthesia.io/

Links:
TabNine Code Completion (Referral): http://bit.ly/tabnine-yannick
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
Discord: https://discord.gg/4H8xxDF

SubscribeStar: https://www.subscribestar.com/yannick...
Patreon: https://www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n