Now showing1 - 1 of 1
  • Some of the metrics are blocked by your 
    Item type:Publication,
    Turnpikes in Deep Learning: beyond ResNets and neural ODEs?
    It is well known that deep learning, and in particular the training of ResNets and neural ODEs, can be formalized and analyzed from an optimal control perspective. In this work, we extend the dynamic systems and optimal control perspectives to fully connected neural networks with ReLU activations and no skip connections. By exploiting equivalence relations between ResNets and networks without skip connections, we show that the corresponding training problems exhibit the turnpike property under conditions analogous to those established for ResNets. We illustrate our findings with numerical experiments for the two-spirals dataset and MNIST.
    Publicationtype: Conference Paper
      13