Question 17
Which statements are true ?
Soft attention is differentiable and can be trained with backpropagation.
Hard attention often needs sampling + REINFORCE (or similar) due to non- differentiability.
Soft attention significantly reduces the computational complexity of the forward pass compared to Hard attention.
Cross-attention can align decoder queries to encoder keys/values (e.g., words attending to image regions).