Question 13
Vanishing gradients in vanilla RNNs are largely caused by:
Too much data augmentation
Repeated multiplication by Jacobians whose spectral norm is often < 1
Using convolutions before the RNN
Using attention layers
Vanishing gradients in vanilla RNNs are largely caused by:
Too much data augmentation
Repeated multiplication by Jacobians whose spectral norm is often < 1
Using convolutions before the RNN
Using attention layers
Correct answer
Repeated multiplication by Jacobians whose spectral norm is often < 1
Question 13 of 22 in the IIT Madras BS Deep Learning for Computer Vision (Deep Learning for Computer Vision) Quiz 2 paper sat on 16 Aug 2026, in the May 2026 term (Deep Learning For Computer Vision 16 Aug 26). It carries 2 marks.