There are 3 main types of gates in a LSTM Model, as follows:
Forget Gate
Input/Update Gate
Output Gate
Forget Gate:- It helps in deciding which data to keep or thrown out
Input Gate:- it helps in determining whether new data should be added in long term memory cell given by previous hidden state and new input data
Output Gate:- this gate gives out the new hidden state
Common things for all these gates are they all take take inputs as the current temporal state/input/word/observation and the previous hidden state output and sigmoid activation is mostly used in all of these.
The-LSTM-unit-contain-a-forget-gate-output-gate-and-input-gate-The-yellow-circle_W640
