Question 17
In the ResNet (Residual Network) architecture, 1 × 1 convolutions are frequently used in the ”bottleneck” building block. Beyond dimensionality reduction, what is an additional benefit of using these layers compared to a standard building block?
They allow the network to increase the spatial resolution of feature maps to recover lost details.
They allow for the addition of non-linearity (via activation functions) without increasing the receptive field or computational cost excessively.
They are used to perform Max Pooling operations within the residual mapping.
They eliminate the need for skip connections by allowing gradients to flow through the 1 × 1 filters instead.