Question 7
Dropout reduces (removes) 25 percent of weights from the model during training and inference
For each iteration, 75% of neurons are dropped randomly from the model
For each iteration, 25% of neurons are dropped randomly from the model
Each weight gets multiplied by a factor p during inference.
Each weight gets multiplied by a factor 1 − p during inference.