Quiz Space

Introduction to Natural Language Processing · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 9: Consider the following sentences: S1: "I like studying LL…

Question 9

+3 marksNumerical answer

Consider the following sentences:

  • S1: "I like studying LLMs"
  • S2: "I like studying big data"
  • S3: "I also like studying computer vision"

Assuming each word is represented by a positional encoding vector with an embedding dimension of 512512, calculate the total number of unique elements in the positional encoding vectors of these sentences.

(Example: Number of unique elements in vectors [3.7,7.3][3.7, 7.3] and [3.4,3.7][3.4, 3.7] and [7.3,3.7][7.3, 3.7] is 33)

Show answer

Correct answer: 3072

Question 9 of 17 in the IIT Madras BS Introduction to Natural Language Processing (Intro to NLP) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 01 Dec 2024). It carries 3 marks.

More questions from this paper

  1. Q1FastText differs from traditional word embedding models like Word2Vec because it can handle out-of-vocabulary (OOV) wor…
  2. Q2Consider the sentences: In a transformer model, each word receives positional encoding. How will the positional encodin…
  3. Q3Figure question
  4. Q4In the encoder of a transformer model, what are the sources of the queries (Q), keys (K), and values (V)?
  5. Q5Given the following statements, select all that are correct:
  6. Q6Consider the following statements about statistical-based (SMT) and example-based (EBMT) machine translation techniques…
  7. Q7Consider a scenario where you are fine-tuning a large language model using LoRA (Low-Rank Adaptation) and QLoRA (Quanti…
  8. Q8You are analysing a collection of customer reviews using the Bag of Words (BoW) model. Here are three sample reviews:\ …
  9. Q10Figure question
  10. Q11Figure question
  11. Q12Consider a reward model in RLHF that uses the Bradley-Terry model to compute pairwise preference probabilities between …
  12. Q13Figure question
  13. Q14Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  14. Q15Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  15. Q16Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  16. Q17Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…