What is vanishing gradient in Machine Learning?

Question

What is vanishing gradient?

Answer 1

As we add more and more hidden layers, backpropagation becomes less useful in passing information to the lower layers. In effect, as information is passed back, the gradients begin to vanish and become small relative to the weights of the network.