Deep Learning Practice Quiz 1 26 Oct 2025 — Question 4
Show answer
Correct answer
Question 4 of 15 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 1 paper sat on 26 Oct 2025, in the September 2025 term (IIT M DEGREE AN EXAM QDB2 26 Oct 2025). It carries 3 marks.
More questions from this paper
- Which of the following statements best describes the primary advantage of the SentencePiece tokenizer compared to a sta…
- When performing full fine-tuning of a large language model (e.g., 10B parameters) using Adam, which component consumes …
- A company wants to align its chatbot with values of being helpful, harmless, and honest. Human labelers provide ideal r…
- After running the following Hugging Face datasets code snippet, what will be the features of the dataset?
- What is a key implication of using a Parameter-Efficient Fine-Tuning (PEFT) method like LoRA when adapting a large lang…
- The WordPiece tokenization algorithm, unlike BPE, does not merge the pair with the highest frequency. Instead, it merge…
- Which of the following statements accurately describes the Causal Language Modeling (CLM) objective used to pre-train m…
- A research lab has access to a powerful 175B parameter language model. They need to adapt it for a highly specialized l…
- A team is fine-tuning a 7B parameter model on a single GPU with 24GB of memory. They are using the Adam optimizer (whic…
- The evolution of NLP models shows a distinct shift from task-specific architectures to a ”pre-train, finetune” paradigm…
- The three main families of Transformer-based models are Encoder-only (e.g., BERT), Decoder-only (e.g.,GPT), and Encoder…
- Figure question
- A single transformer block in a GPT-style model has the following configuration: embedding dimension (d model) = 1024, …
- You are given a GPT-style model with a vocabulary size of 50,257, a context length of 1024, and an embedding dimension …