How to visualize training dynamics in neural networks
May 1, 2025
Sometimes I am a Tree: Data drives fragile hierarchical generalization
Feb 1, 2025
Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs
Jan 1, 2024
Mechanistic?
Jan 1, 2024
Loss in the Crowd: Hidden Breakthroughs in Language Model Training
Jan 1, 2024
Causation Does Not Imply Correlation: A Study of Circuit Mechanisms and Model Behaviors
Jan 1, 2024
The Parable of the Prinia's Egg: An Allegory for AI Science
I discuss what counts as strong evidence for an explanation of model behavior.
Sep 17, 2023
Towards out-of-distribution generalization in large-scale astronomical surveys: robust networks learn similar representations
Jan 1, 2023
Shapley Interactions for Complex Feature Attribution
Jan 1, 2023
Linear Connectivity Reveals Generalization Strategies
Jan 1, 2023