What is vanishing gradient in Machine Learning?

Question

Q: What is vanishing gradient?

Answer 1

As we add more and more hidden layers, backpropagation becomes less useful in passing information to the lower layers. In effect, as information is passed back, the gradients begin to vanish and become small relative to the weights of the network.