Adam, Adam, who the f..k is Adam?

This paper makes a bold claim! AlphaGo Moment for Model Architecture Discovery The researchers introduce ASI-Arch, the first Artificial Superintelligence for AI Research (ASI4AI), enabling fully automated neural architecture innovation. No human-designed search space. No human in the loop. 🔍 Key Breakthroughs of ASI-Arch: - Autonomous code generation & training - 1,773 experiments conducted (20K+ GPU hours) - 106 new SOTA linear attention architectures discovered - Unveiled a scaling law for scientific discovery

⏱️AI is making verification process easier, with models verifying proofs in minutes. 💻 Now, @prfsanjeevarora, @chijinML, @danqi_chen and @PrincetonPLI have released Goedel Prover V2, a model more efficient and more accurate than any previous model. 👉

An advanced version of Gemini with Deep Think has officially achieved gold medal-level performance at the International Mathematical Olympiad. 🥇 It solved 5️⃣ out of 6️⃣ exceptionally difficult problems, involving algebra, combinatorics, geometry and number theory. Here’s how 🧵

BatchNorm wins the Test-of-Time Award at #ICML2025! 🎉 BatchNorm revolutionized deep learning by addressing internal covariate shift, which can slow down learning, limits learning rates, and makes it difficult to train deep networks. By normalizing inputs within each mini-batch, BatchNorm significantly stabilized and accelerated training. It enabled higher learning rates, improved gradient flow, and paved the way for much deeper architectures like ResNet. Beyond reducing internal covariate shift, BatchNorm also smooths the optimization landscape and improves model generalization, making it a cornerstone of modern neural network training. Very well deserved, @Sergey_xai and @ChrSzegedy!

#ICML2025 test of time award

New @Scale_AI paper! 🌟 LLMs trained with RL can exploit reward hacks but not mention this in their CoT. We introduce verbalization fine-tuning (VFT)—teaching models to say when they're reward hacking—dramatically reducing the rate of undetected hacks (6% vs. baseline of 88%).

a guy created a dataset of 50 books from London 1800-1850 for LLM training. no modern bias. it’s actually super cool to see what can be trained on it!

Par, an expressive, concurrent, total* language with linear types and full duality. Based on Linear Logic and Session Types, Par has both functional and imperative features integrating seamlessly

A melon-sized cherry on top :)