Measuring the depth of a model: how deep is deep?
A fascinating question in modern machine learning has to do with how to measure the depth of a model. In the simplest setting, neural networks are either recurrent or feedforward. A feedforward network contains no directed cycles in its computational graph, which means it can be neatly organised into successive