New Arxiv techrep: Hamiltonian DNN have no vanishing gradients!
© 2021 EPFL
In our ArXiv work we prove that Hamiltonian deep networks do not suffer from vanishing gradients, if they are suitably designed.
The technical report is entitled "Hamiltonian Deep Neural Networks Guaranteeing Non-vanishing Gradients by Design" and it is available here.