Quiz Space

Deep Learning · End Term · 3 Sept 2023 · May 2023 term · Set QPE1-S2

Question 14: Suppose all words in the vocabulary are represented usin…

Question 14

+3 marksNumerical answer

Consider a sentence inside the quote “I may be wrong, and you may be right, and by an effort, we may get nearer to the truth”
Based on the above data, answer the given subquestions.

Suppose all words in the vocabulary are represented using one-hot-encoded vector of size ∣V∣|V|. Then compute the ordered pair-wise (that is, Cartesian product of V×VV \times V) cosine similarity between two word representations and enter their sum.

Show answer

Correct answer: 16

See the whole paperTake it as a mock test

Question 14 of 17 in the IIT Madras BS Deep Learning (Deep Learning) End Term paper sat on 3 Sept 2023, in the May 2023 term (IIT M DEGREE ET1 EXAM QPE1 S2 03 Sep). It carries 3 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Consider the statement “the attention mechanism in RNN based Encoder- Decoder architecture helps the decoder to underst…
  3. Q3Figure question
  4. Q4Figure question
  5. Q5Suppose that we have a deep Feed Forward Fully Connected Neural Network. The network is observed to have a high varianc…
  6. Q6The logistic sigmoid function is defined as follows, f(x) = \frac{1}{1 + exp(-(wx + b))} The parameters are initialized…
  7. Q7Figure question
  8. Q8Figure question
  9. Q9Consider a simple RNN for a binary sequence classification problem.
  10. Q10How many neurons are there in the network. Every neuron in the network has bias associated with it?\ Note: A neuron is …
  11. Q11How many learnable parameters (including bias) does the network have? Assume dropout regularization is applied.
  12. Q12The statement that, in general, the activation function of neurons in the network are not necessarily be the same acros…
  13. Q13Consider a sentence inside the quote “I may be wrong, and you may be right, and by an effort, we may get nearer to the …
  14. Q15The update rule for the ADAM (Adaptive Moments) optimization algorithm is given below, \begin{aligned} m_t &= \beta_1 m…
  15. Q16Suppose the input is x (one hot representation of context word) and the corresponding label is y (one hot representatio…
  16. Q17Based on the above data, answer the given subquestions.