Question 8
Consider the following code:
import torchimport torch.nn as nn
model = nn.Sequential( nn.Linear(10, 10), nn.BatchNorm1d(10), nn.ReLU(), nn.Dropout(p=0.5), nn.Linear(10, 1))X = torch.randn(4, 10)
# Run in training modemodel.train()out_train = model(X)
# Run in evaluation modemodel.eval()out_eval = model(X)
print(out_train)print(out_eval)Removing which of the following layers will make out_train and out_eval identical for the same input?