Quiz Space

Deep Learning Practice · Quiz 1 · 26 Oct 2025 · September 2025 term

Question 6: What is a key implication of using a Parameter-Efficient …

Question 6

+3 marksOne correct option

What is a key implication of using a Parameter-Efficient Fine-Tuning (PEFT) method like LoRA when adapting a large language model for a new task?

  1. A

    Inference speed is 10x faster.

  2. B

    Only a small number of new parameters are trained while freezing original weights.

  3. C

    It eliminates the need for labeled data.

  4. D

    Model must be retrained from scratch.

Show answer

Correct answer

  • B

    Only a small number of new parameters are trained while freezing original weights.

See the whole paperTake it as a mock test

Question 6 of 15 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 1 paper sat on 26 Oct 2025, in the September 2025 term (IIT M DEGREE AN EXAM QDB2 26 Oct 2025). It carries 3 marks.

More questions from this paper

  1. Q1Which of the following statements best describes the primary advantage of the SentencePiece tokenizer compared to a sta…
  2. Q2When performing full fine-tuning of a large language model (e.g., 10B parameters) using Adam, which component consumes …
  3. Q3A company wants to align its chatbot with values of being helpful, harmless, and honest. Human labelers provide ideal r…
  4. Q4Figure question
  5. Q5After running the following Hugging Face datasets code snippet, what will be the features of the dataset?
  6. Q7The WordPiece tokenization algorithm, unlike BPE, does not merge the pair with the highest frequency. Instead, it merge…
  7. Q8Which of the following statements accurately describes the Causal Language Modeling (CLM) objective used to pre-train m…
  8. Q9A research lab has access to a powerful 175B parameter language model. They need to adapt it for a highly specialized l…
  9. Q10A team is fine-tuning a 7B parameter model on a single GPU with 24GB of memory. They are using the Adam optimizer (whic…
  10. Q11The evolution of NLP models shows a distinct shift from task-specific architectures to a ”pre-train, finetune” paradigm…
  11. Q12The three main families of Transformer-based models are Encoder-only (e.g., BERT), Decoder-only (e.g.,GPT), and Encoder…
  12. Q13Figure question
  13. Q14A single transformer block in a GPT-style model has the following configuration: embedding dimension (d model) = 1024, …
  14. Q15You are given a GPT-style model with a vocabulary size of 50,257, a context length of 1024, and an embedding dimension …