Match the following attention mechanisms to their corresponding alignment score functions: | (1) General Attention | (i) v_a^\top \tanh(W_a[s_t; h_i]) | |---|---| | (2) Content-Based Attention | (ii) \alpha_{t,j} = \text{softmax}(W_a s_t) | | (3) Dot-Product Attention | (iii)s_t^\top h_i | | (4) Additive Attention | (iv) \cos(s_t, h_i) | | (5) Location-Based Attention | (v) s_t^\top W_a h_i |

(D) 1→v, 2→iv, 3→iii, 4→i,5→ii

(A) 1→iii, 2→ii, 3→v, 4→iv,5→i

(B) 1→iii, 2→iv, 3→i, 4→ii,5→v

(C) 1→i, 2→iii, 3→iv, 4→ii,5→v

Deep Learning for Computer Vision · Quiz 2 · 16 Mar 2025 · January 2025 term

Question 11: Match the following attention mechanisms to their corres…

Question 11

+2 marksOne correct option

Match the following attention mechanisms to their corresponding alignment score functions:

(1) General Attention	(i) $v_a^\top \tanh(W_a[s_t; h_i])$
(2) Content-Based Attention	(ii) $\alpha_{t,j} = \text{softmax}(W_a s_t)$
(3) Dot-Product Attention	(iii) $s_t^\top h_i$
(4) Additive Attention	(iv) $\cos(s_t, h_i)$
(5) Location-Based Attention	(v) $s_t^\top W_a h_i$

A
1→iii, 2→ii, 3→v, 4→iv,5→i
B
1→iii, 2→iv, 3→i, 4→ii,5→v
C
1→i, 2→iii, 3→iv, 4→ii,5→v
D
1→v, 2→iv, 3→iii, 4→i,5→ii

Show answer

Correct answer

D
1→v, 2→iv, 3→iii, 4→i,5→ii

Video solution

The video solution to this question is being recorded and will play here. Until then, the answer key is above.

See the whole paper Take it as a mock test

Question 11 of 37 in the IIT Madras BS Deep Learning for Computer Vision (Deep Learning for Computer Vision) Quiz 2 paper sat on 16 Mar 2025, in the January 2025 term (IIT M IMPROVEMENT AN EXAM QIM2 16 Mar 2025). It carries 2 marks.

Question 11: Match the following attention mechanisms to their corres…

Question 11

Video solution

More questions from this paper