Question 12
Which of the following techniques help control the exploding or vanishing gradient problem in recurrent neural networks?
1. Gradient clipping
2. Use ReLU activation funtion to control exploding gradient and sigmoid activation to control vanishing gradients
3. Use Long Short-Term Memory (LSTM)
4. Use data augmentation methods (for example, reversing the input sequence)
1, 2, and 3; but not 4
1, 3, and 4; but not 2
All of these
Only 1 and 3