Your Brain on Code: What Brains and AI Models Both Learn
Shashank Srikant
NeurIPS · 2022Paper discussed
Using brain recordings to read what AI models of code have learned, and what people represent when they read programs.
Topic
Models whose reasoning people can read and check: Bayesian models with meaningful parameters, grammars and programs that encode domain knowledge, and methods for probing what neural networks have learned.
5 episodes
Interpretable AI is the subject the show is named for. In this podcast it means models whose reasoning a person can read and check, and the five episodes in this topic show five different ways to get there. Episode 002 uses a Bayesian model whose parameters have meaning: PyR0 attributes the growth of SARS-CoV-2 lineages to individual mutations, with uncertainty. Episode 003 uses a grammar: a set of production rules learned from data that a chemist can read one by one. Episode 004 offers a model of human reasoning, value-guided construal, precise enough to make predictions and test them in experiments.
Episode 005 turns the question around and asks how to know what an AI model of code has learned, by lining up its internal representations with fMRI recordings of programmers. Episode 000, from the host, Omar Costilla Reyes, explains the idea behind the name: when part of a model is written as a program, scientists can read, test, and correct it. Each episode is anchored to a published paper, listed below with its venue, year, and link, so the claims on this page can be checked at the source.
Shashank Srikant
NeurIPS · 2022Paper discussed
Using brain recordings to read what AI models of code have learned, and what people represent when they read programs.
Mark K. Ho
Nature · 2022Paper discussed
A precise, testable model of how people simplify problems before they plan.
Minghao Guo
ICLR · 2022Paper discussed
A generative model for chemistry built from learned rules: valid by design and readable by chemists.
Dr. Jacob E. Lemieux
Science · 2022Paper discussed
An interpretable Bayesian model that turns millions of viral genomes into a fitness estimate for each mutation.
Dr. Omar Costilla Reyes
NeurIPS · 2022Paper discussed
Why scientific knowledge looks like code, and why that makes AI readable.