Question 2
The statement that KV caching is not helpful during inference in encoder models like BERT is
TRUE
FALSE
Question 2: The statement that KV caching is not helpful during infer…
Show answer
Correct answer
TRUE
Question 2 of 15 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 13 Apr 2025, in the January 2025 term (IIT M DEGREE FN EXAM QDB2 13 Apr 2025). It carries 2 marks.
This question was also asked in
More questions from this paper
- Suppose we are given a Model A with N layers and a dataset with D tokens. Choose the correct statements according to th…
- Consider the problem of length extrapolation using the Absolute Position Encoding (APE) scheme. Suppose the context len…
- Select correct statements about sinusoidal positional encoding:
- Suppose we have a dataset for machine translation tasks with thousands of samples. Suppose a team considers training th…
- Select correct statements regarding character level tokenization:\ Note: Assume that the character level vocabulary has…
- Which of the following are design choices for building a large language model?
- Figure question
- Figure question
- Consider following distribution generated by a GPT model after feeding the sentence “I love Manali because it is so”: C…
- Consider following distribution generated by a GPT model after feeding the sentence “I love Manali because it is so”: C…
- Consider the following dictionary with the number of word occurrences in a corpus: Consider the following dictionary wi…
- Consider the following dictionary with the number of word occurrences in a corpus: Consider the following dictionary wi…
- Consider the following dictionary with the number of word occurrences in a corpus: Consider the following dictionary wi…
- Of these 4 blocks, choose the block(s) that is (are) proper permutation of 4 blocks.