Quiz Space

Deep Learning Practice · Quiz 1 · 23 Feb 2025 · January 2025 term

Question 4: Given the following code snippet: Which of the following …

Question 4

+3 marksOne correct option

Given the following code snippet:

python
from transformers import AutoModelForSequenceClassification
from peft import LoraConfig


base_model = AutoModelForSequenceClassification.from_pretrained("bert-base-uncased", num_labels=2)
lora_config = LoraConfig(
    r=8,
    lora_alpha=16,
    lora_dropout=0.1
)

Which of the following options correctly adds LoRA to the base_model? (Whichever option you choose, assume the corresponding imports already done for them)

  1. A
  2. B
  3. C
  4. D
Show answer

Correct answer

  • D
See the whole paperTake it as a mock test

Question 4 of 16 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 1 paper sat on 23 Feb 2025, in the January 2025 term (IIT M DEGREE AN EXAM QDB2 23 Feb 2025). It carries 3 marks.

More questions from this paper

  1. Q1Figure question
  2. Q2Consider the following code where a tokenizer is created using the BPE model: Which of the following statements is corr…
  3. Q3Consider the following code snippet: What will likely be printed as the output?
  4. Q5Given the following code for setting up the trainer: Which of the following lines correctly starts the fine-tuning proc…
  5. Q6What would happen if you set the target_modules parameter in the LoraConfig to an empty list []?
  6. Q7Consider the following code where the tokenizer is trained using two different vocabulary sizes: 5K and 50K. The functi…
  7. Q8What type of language modeling objective is used during the pretraining of GPT-2?
  8. Q9Which of the following is/are gradient based (fine tuning) methods?
  9. Q10Figure question
  10. Q11Select all the correct statements.
  11. Q12You are working with two datasets and trying to combine them using the following code: Assume the following: The ds1 da…
  12. Q13The original train split contains 25,000 samples, and 60% of the samples have a text length greater than 200. If the da…
  13. Q14Below is a snippet for loading the GPT-2 model configuration: the output of the above is Based on the above data, answe…
  14. Q15Below is a snippet for loading the GPT-2 model configuration: the output of the above is Based on the above data, answe…
  15. Q16Below is a snippet for loading the GPT-2 model configuration: the output of the above is Based on the above data, answe…