Question 5
How does dropout affect the behavior of the neural network during the inference phase?
All neurons are dropped randomly as in the training phase.
Only a subset of neurons is kept active, and their outputs are scaled by the keep probability.
All neurons are active, and their outputs are typically scaled by the keep probability to maintain consistency with the training phase.
Dropout is not applied during the inference phase, and no scaling is necessary.