The topic of generative AI unites key concepts in machine learning. Follows us to learn more about all things AI.thevariationalbook.com United StatesJoined November 2023
New paper:
We present a "Unified Neural Scaling Law" functional form that accurately models & extrapolates the multivariate scaling behaviors of artificial neural networks as the variables listed in this attached video are varied.
(1/N)
Introducing Flux Matching, a generative modeling paradigm that generalizes diffusion models to vector fields that need not be the score function.
Enables structural priors in the dynamics, faster sampling, interpretable generation, and more!
w/ @StefanoErmon@Xiaojie_Qiu 🧵⤵️
New paper! Presenting Discrete Flow Maps:
paper: arxiv.org/abs/2604.09784
blog: malbergo.me/discrete-flow-…
A laughable problem for me these days is that @nmboffi and I share a research brain, and we have had, time and again, a conversation that ends with “ha so I guess we’re writing the same paper.” Soon we will return to just doing it together :). Here we are doing it again with discrete flow maps and flow language models! A complete and thorough paper led by @PPotaptchik@json_yim@adhisarav@peholderrieth. We took a bit of time to post it to ensure we understood a few more things about the stability of the loss functions.
Like @osclsd , @FEijkelboom, and @nmboffi , we think this could be a very helpful paradigm for thinking about fast inference and even better alignment!
Here’s our version of the story, and I hope it makes clear how green field this research direction is — we provide a comprehensive picture of the KL losses you can write from the properties of the flow map, some nice geometric proofs about the mean denoiser and the simplex, and find that at this time, the ESD can actually be the most performant, with some caveats. Excited for everyone to work together and push this class of models to their limit!
@thimabru Hi Thiago, very much appreciate the enthusiasm, and thank you for asking. Right now I'm editing, refining and aiming for release in the next few months. In the interim, happy to help as can
4K Followers 1K FollowingAssistant Professor @BristolUni, PhD @UCL AI Center, prev. intern @TikTok & @Microsoft. ✨ Reinforcement Learning, Causality, World Models. 🎮 Game Fan!
334 Followers 1K FollowingI like pigs. Pigs are very clean animals; they can't sweat. They are smart and have an excellent memory. Mother pigs sing to their babies. Pigs love belly rubs!
46K Followers 3K FollowingDirector of bioinformatics at AstraZeneca. YouTube at chatomics. On my way to helping 1 million people learn bioinformatics. Also talks about leadership.
6K Followers 418 FollowingAssistant Professor of Computing Science @SFU. Ph.D. from @Berkeley_EECS and Bachelor's from @UofTCompSci. Formerly @GoogleAI and Member of @the_IAS.
28K Followers 752 FollowingProfessor and Head of Machine Learning Department at @CarnegieMellon. Board member @OpenAI and @Qualcomm. Chief Scientist @GraySwanAI.
5K Followers 53 FollowingI 👨🔬 a math. definition&theory of Artificial Super-Intelligence 🎥&🎤@ https://t.co/OZsooP9AbV 🍀
I now work @GoogleDeepMind 🧠 History:🇩🇪🇨🇭🇦🇺🇬🇧
308K Followers 480 FollowingPython's BDFL-emeritus, Distinguished Engineer at Microsoft, Computer History Fellow, fully vaccinated. Opinions are my own. He/him.
56K Followers 974 FollowingTeaches math to engineers: https://t.co/TJ5i3Pg678
Professor @UW researching #MachineLearning for #Dynamics and #Control, especially for #FluidDynamics.
12K Followers 776 FollowingProfessor in Machine Learning, Gatsby Computational Neuroscience Unit
Research Scientist, Google DeepMind
https://t.co/JJNqmn7jak
6K Followers 418 FollowingAssistant Professor of Computing Science @SFU. Ph.D. from @Berkeley_EECS and Bachelor's from @UofTCompSci. Formerly @GoogleAI and Member of @the_IAS.
39K Followers 740 FollowingMLST is by Dr. Tim Scarfe @ecsquendor w/ cameos from @DoctorDuggar https://t.co/5YCv2SdFwN (early access/priv.discord) - Sponsor us!
21K Followers 1K FollowingHanging out with Claude, improving its behavior, and building tools to support that @AnthropicAI 😁
prev: @open_phil @googlebrain @openai (@microcovid)
585K Followers 50K FollowingSan Francisco/Silicon Valley AI | Robots, holodecks, BCIs, analysis of new things | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future.
42K Followers 261 FollowingWorking towards the safe development of AI for the benefit of all @UMontreal, @LawZero_ & @Mila_Quebec
A.M. Turing Award Recipient and most-cited AI researcher.
30K Followers 4K FollowingSlop janitor & post-trainologer at Meta / FAIR. Into codegen, RL, equivariance. Spent time at Qualcomm, Scyfer (acquired), UvA, Deepmind, OpenAI.
11K Followers 451 FollowingCode, AI, and 3D printing. Opinions are mostly my own, sometimes a computer's. Husband of @thesamnichol. Co-creator of DALL-E 2. Researcher @openai.
38K Followers 942 FollowingCEO @unconvai. Former CEO MosaicML/Databricks & Nervana/IntelAI. Neuro + CS. I like to build stuff that will eventually learn how to build other stuff.
130K Followers 178 FollowingProfessor of computer science at UW and author of '2040' and 'The Master Algorithm'. Into machine learning, AI, and anything that makes me curious.
19K Followers 972 FollowingSoftware Engineer @ Google
Part Time Lecturer @ UCLA
ML/NLP, databases, data management systems, distributed systems, mountain biking.
Opinions my own.
93K Followers 80K FollowingCEO MV Procu GmbH. Passionate about life & coffee. PhD & MBA in Economics. Social Media enthusiast and curious to continuously learn & grow. Carpe Diem