0 votes
in Deep Learning by
What are the main gates in LSTM and what are their tasks?

1 Answer

0 votes
by

There are 3 main types of gates in a LSTM Model, as follows:

Forget Gate

Input/Update Gate

Output Gate

Forget Gate:- It helps in deciding which data to keep or thrown out

Input Gate:- it helps in determining whether new data should be added in long term memory cell given by previous hidden state and new input data

Output Gate:- this gate gives out the new hidden state

Common things for all these gates are they all take take inputs as the current temporal state/input/word/observation and the previous hidden state output and sigmoid activation is mostly used in all of these.

The-LSTM-unit-contain-a-forget-gate-output-gate-and-input-gate-The-yellow-circle_W640

...