Question 16
Which statements are true?
Soft attention is differentiable and can be trained with backpropagation.
Hard attention often needs sampling + REINFORCE (or similar) due to non- differentiability.
Hard attention always has higher test-time compute than soft attention.
Cross-attention can align decoder queries to encoder keys/values (e.g., words attending to image regions).