Question 6
Select the statements that correctly distinguish fine-tuning from zero-shot prompting for GPT-style models.
In Fine-Tuning, the weights of the pre-trained model (and often a new specific head) are updated using backpropagation on a labeled dataset.
In Zero-Shot Prompting, the model weights are frozen (not updated); the task is formulated purely through the design of the input text (prompt).
Zero-Shot Prompting generally achieves higher accuracy than Fine-Tuning when abundant labeled data is available.
Fine-Tuning typically requires a task-specific output layer (like a linear classifier), whereas Zero-Shot Prompting relies on the model generating text directly.