Training Dynamics

LSTMs Compose---and Learn---Bottom-Up

Understanding Learning Dynamics Of Language Models with SVCCA

Sparsity Emerges Naturally in Neural Language Models