Quiz Space

Introduction to Natural Language Processing · Quiz 2 · 1 Dec 2024 · September 2024 term

Question 1: FastText differs from traditional word embedding models l…

Question 1

+2 marksOne correct option

FastText differs from traditional word embedding models like Word2Vec because it can handle out-of-vocabulary (OOV) words more effectively. Which of the following best explains how FastText achieves this capability?

  1. A

    FastText predicts context words using an entire sentence rather than just nearby words.

  2. B

    FastText generates embeddings by averaging multiple pre-trained word vectors.

  3. C

    FastText breaks words down into smaller subword units (character n-grams) and creates embeddings based on these subwords, allowing it to estimate embeddings for unseen words.

  4. D

    FastText uses neural networks with an additional layer dedicated to identifying unknown words.

Show answer

Correct answer

  • C

    FastText breaks words down into smaller subword units (character n-grams) and creates embeddings based on these subwords, allowing it to estimate embeddings for unseen words.

Question 1 of 17 in the IIT Madras BS Introduction to Natural Language Processing (Intro to NLP) Quiz 2 paper sat on 1 Dec 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 01 Dec 2024). It carries 2 marks.

More questions from this paper

  1. Q2Consider the sentences: In a transformer model, each word receives positional encoding. How will the positional encodin…
  2. Q3Figure question
  3. Q4In the encoder of a transformer model, what are the sources of the queries (Q), keys (K), and values (V)?
  4. Q5Given the following statements, select all that are correct:
  5. Q6Consider the following statements about statistical-based (SMT) and example-based (EBMT) machine translation techniques…
  6. Q7Consider a scenario where you are fine-tuning a large language model using LoRA (Low-Rank Adaptation) and QLoRA (Quanti…
  7. Q8You are analysing a collection of customer reviews using the Bag of Words (BoW) model. Here are three sample reviews:\ …
  8. Q9Consider the following sentences: S1: "I like studying LLMs" S2: "I like studying big data" S3: "I also like studying c…
  9. Q10Figure question
  10. Q11Figure question
  11. Q12Consider a reward model in RLHF that uses the Bradley-Terry model to compute pairwise preference probabilities between …
  12. Q13Figure question
  13. Q14Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  14. Q15Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  15. Q16Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…
  16. Q17Consider an RNN for a language modelling task with one hidden layer, trained with cross-entropy loss with a softmax ove…