Quiz Space

Deep Learning · End Term · 30 Apr 2023 · January 2023 term

Question 5: Consider a skip-gram model shown below. Each word in the …

Question 5

+3 marksNumerical answer

Consider a skip-gram model shown below. Each word in the vocabulary is represented as one-hot vector of size 100×1. The embedding dimension h is 5×1. Enter the number of parameters (exclude bias) in the entire network

Consider a skip-gram model shown below. Each word in the vocabulary is represented as one-hot vector of size 100×1. The embedding dimension h is 5×1. Enter the number of parameters (exclude bias) in the entire network

Show answer

Correct answer: 2500

See the whole paperTake it as a mock test

Question 5 of 16 in the IIT Madras BS Deep Learning (Deep Learning) End Term paper sat on 30 Apr 2023, in the January 2023 term (IIT M DEGREE ET1 EXAM QPE2 S1 30 Apr 2023). It carries 3 marks.

More questions from this paper

  1. Q1Suppose that we implement a three input Boolean function using the Mc-Culloch Pitts (MP) neuron. The graph below shows …
  2. Q2Consider the following two sentences\ A man was sitting at the bank of the river and gazing at stars in the sky • A man…
  3. Q3Figure question
  4. Q4Figure question
  5. Q6Based on the above data, answer the given subquestions.
  6. Q7Suppose that all the elements in the input vector are zero and the corresponding true label is also 0. Further, suppose…
  7. Q8Assume that we use backpropagation to compute the gradient of the loss w.r.t. all the parameters. Then the statement th…
  8. Q9The plot below shows contours of a function f(w, b). Choose the correct statements The plot below shows contours of a f…
  9. Q10Suppose that a model produces zero training error without using any regularization technique. What happens if we use L2…
  10. Q11Suppose we divide the available training samples into mini batches of size 32 to train a model with mini-batch gradient…
  11. Q12A text corpus contained the following two sentences.\ In science if you know what you are doing you should not be doing…
  12. Q13Suppose we build a co-occurrence matrix of size m × n, where each row corresponds to a word in the vocabulary and the c…
  13. Q14Consider a simple RNN for a binary sequence classification problem. Consider a simple RNN for a binary sequence classif…
  14. Q15Consider a simple RNN for a binary sequence classification problem. Consider a simple RNN for a binary sequence classif…
  15. Q16Consider the statement “the attention coefficients in RNN based Encoder- Decoder architecture are computed for each tim…