Natural Gradient Descent (NGD) is a second-order neural network training that preconditions the gradient descent with the inverse of the Fisher Information Matrix (FIM). Although NGD provides an ...

In this paper, a novel variable order fractional gradient descent optimization algorithm is proposed, which generalizes the classical gradient descent method by introducing a kind of variable order ...