Quiz Space

Introduction to Natural Language Processing · End Term · 13 Apr 2025 · January 2025 term

Question 23: A transformer-based Retrieval-Augmented Generation (RAG)…

Question 23

+4 marksNumerical answer

A transformer-based Retrieval-Augmented Generation (RAG) system retrieves the top-10 most relevant passages, where each passage contains 512 tokens. However, a portion of the model's 4096-token context length is reserved for the input query and special tokens (e.g., separators, instructions). If the model reserves 1024 tokens for the input query, how many full retrieved passages can fit within the remaining context window?

Show answer

Correct answer: 6

See the whole paperTake it as a mock test

Question 23 of 25 in the IIT Madras BS Introduction to Natural Language Processing (Intro to NLP) End Term paper sat on 13 Apr 2025, in the January 2025 term (IIT M FOUNDATION AN EXAM QDF3 13 Apr 2025). It carries 4 marks.

More questions from this paper

  1. Q1Why might accuracy be a misleading metric for evaluating POS tagging systems in cases of class imbalance?
  2. Q2In stochastic POS tagging, why is it necessary to calculate both individual word probabilities and tag sequence probabi…
  3. Q3How does Retrieval-Augmented Generation (RAG) differ from standard parametric models like GPT-3?
  4. Q4Which of the following architectures is most commonly used as the generator in RAG models?
  5. Q5A company wants to optimize an LLM for programming tasks. Which approach is the most efficient if they have limited lab…
  6. Q6Which of the following statements about Attention Flow in Transformer models is TRUE?
  7. Q7Which of the following scenarios represents an ethical concern with LLM deployment?
  8. Q8How does an LSTM differ from a standard RNN in terms of remembering information?
  9. Q9In the context of speculative decoding, a draft model predicts three tokens: "a", "quick", "fox". The main model assign…
  10. Q10Consider the following attention matrices for two layers (corresponding to tokens 1 and 2) in a transformer model:\ Lay…
  11. Q11Which of the following sentences contain pragmatic ambiguity due to potential sarcasm or irony?
  12. Q12Which of the following statements correctly describe how BERT differs from GPT and standard transformer models?
  13. Q13Which of the following statements is/are incorrect regarding Reinforcement Learning from Human Feedback (RLHF), Supervi…
  14. Q14During sequence-to-sequence model training, which of the following statements is/are correct regarding Teacher Forcing …
  15. Q15Which of the following statements about beam search is/are incorrect ?
  16. Q16Which components are essential in a RAG pipeline?
  17. Q17Which of the following are the examples of unintended bias in an NLP model?
  18. Q18Which of the following factors contribute to bias amplification in NLP models?
  19. Q19Figure question
  20. Q20In a transition-based parser using SHIFT, LEFTARC, and RIGHTARC operations, what is the minimum number of operations ne…
  21. Q21A TF-IDF model is applied to a document corpus of 50,000 documents. The term "optimization" appears in 750 documents. I…
  22. Q22A beam search with beam width = 4 and vocabulary size = 8 is run for 3 decoding steps. How many sequences will remain a…
  23. Q24Consider the following regression model:\ F(x) = 500 Age + 1000 Income + 20000\ For an input with:\ Age = 30\ Income = …
  24. Q25An e-commerce company predicts the total sales (in dollars) based on 3 key features: Discount (e.g., 10%, 20%) Social M…