0 votes
in Deep Learning by
Is it possible to train a neural network model by setting all biases to 0? Also, is it possible to train a neural network model by setting all of the weights to 0?

1 Answer

0 votes
by

Yes, even if all of the biases are set to zero, the neural network model has a chance of learning. 

No, training a model by setting all of the weights to 0 is impossible since the neural network will never learn to complete a task. When all weights are set to zero, the derivatives for each w remain constant, resulting in neurons learning the same features in each iteration. Any constant initialization of weights, not simply zero, is likely to generate a poor result.

Related questions

0 votes
asked Dec 13, 2022 in Deep Learning by Robindeniel
+1 vote
asked Jul 17, 2020 in Deep Learning by RShastri
...