Gradient surfing — the hidden role of regularization

This is an link post, originally posted at https://www.lesswrong.com/posts/Fjoy5SxgBmxfy7FNB/gradient-surfing-the-hidden-role-of-regularization.