Quiz Space

Introduction to Natural Language Processing · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 2: Consider the sentences: In a transformer model, each word…

Question 2

+3 marksOne correct option

Consider the sentences:

In a transformer model, each word receives positional encoding. How will the positional encoding of "playful" differ across these sentences?

  1. A

    It will be identical in all three sentences.

  2. B

    It will vary in each sentence based on the position of "playful" within that sentence.

  3. C

    It will vary only if "playful" has a different meaning.

  4. D

    It will be identical but scaled by the number of words in each sentence.

Show answer

Correct answer

  • B

    It will vary in each sentence based on the position of "playful" within that sentence.

See the whole paperTake it as a mock test

Question 2 of 17 in the IIT Madras BS Introduction to Natural Language Processing (Intro to NLP) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 01 Dec 2024). It carries 3 marks.

More questions from this paper

  1. Q1FastText differs from traditional word embedding models like Word2Vec because it can handle out-of-vocabulary (OOV) wor…
  2. Q3Figure question
  3. Q4In the encoder of a transformer model, what are the sources of the queries (Q), keys (K), and values (V)?
  4. Q5Given the following statements, select all that are correct:
  5. Q6Consider the following statements about statistical-based (SMT) and example-based (EBMT) machine translation techniques…
  6. Q7Consider a scenario where you are fine-tuning a large language model using LoRA (Low-Rank Adaptation) and QLoRA (Quanti…
  7. Q8You are analysing a collection of customer reviews using the Bag of Words (BoW) model. Here are three sample reviews:\ …
  8. Q9Consider the following sentences: S1: "I like studying LLMs" S2: "I like studying big data" S3: "I also like studying c…
  9. Q10Figure question
  10. Q11Figure question
  11. Q12Consider a reward model in RLHF that uses the Bradley-Terry model to compute pairwise preference probabilities between …
  12. Q13Figure question
  13. Q14Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  14. Q15Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  15. Q16Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  16. Q17Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…