Question 13
Which of the following techniques help control the exploding or vanishing gradient problem in recurrent neural networks?
Gradient clipping
Use ReLU activation funtion to control exploding gradient and sigmoidactivation to control vanishing gradients
Use Long Short-Term Memory (LSTM)
Use data augmentation methods (for example, reversing the input sequence)