Question 6
Suppose the T5 base model has to be fine tuned with gradual unfreezing. First layer of the encoder takes the input in appropriate format. Gradual unfreezing is divided in 12 (i.e. no. of layers) phases.
Choose the correct statements:
In the first phase, weights of only the last layer of encoder and decoder (both) are unfrozen.
In the first phase, weights of only the last layer of decoder only are unfrozen.
In the first phase, weights of only the last layer of encoder only are unfrozen.
In the second phase, weights of only the second last layer of encoder and decoder (both) are unfrozen.
In the second phase, weights of the last two layers of encoder and decoder (both) are unfrozen.
In the first phase, weights of only the first layer of encoder and decoder (both) are unfrozen.