Quiz Space

Deep Learning Practice · Quiz 1 · 13 Jul 2025 · May 2025 term

Question 4: Consider the following Python code snippet using Hugging …

Question 4

+3 marksOne correct option

Consider the following Python code snippet using Hugging Face tokenizers:

python
from tokenizers import Tokenizer
from tokenizers.models import BPE
from tokenizers.pre_tokenizers import Whitespace
from tokenizers.normalizers import Lowercase
from tokenizers.processors import TemplateProcessing


tokenizer = Tokenizer(BPE(unk_token="[UNK]"))
tokenizer.normalizer = Lowercase()
tokenizer.pre_tokenizer = Whitespace()


tokenizer.post_processor = TemplateProcessing(
    single="[CLS] $A [SEP]",
    pair="[CLS] $A [SEP] $B:1 [SEP]:1",
    special_tokens=[("[CLS]", tokenizer.token_to_id("[CLS]")),
                    ("[SEP]", tokenizer.token_to_id("[SEP]"))],
)
encoded_output = tokenizer.encode("Hello World")

Which of the following attributes would be present in the encoded_output object and directly reflect the action of the TemplateProcessing post-processor for a single sequence as configured?

  1. A
  2. B
  3. C
  4. D
Show answer

Correct answer

  • D
See the whole paperTake it as a mock test

Question 4 of 16 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 1 paper sat on 13 Jul 2025, in the May 2025 term (IIT M DEGREE AN EXAM QDB2 13 July 2025). It carries 3 marks.

More questions from this paper

  1. Q1A start-up is building a new language model for a low-resource language with many compound words and complex morphology…
  2. Q2When fully fine-tuning a large pre-trained Transformer model (e.g., >1 Billion parameters), which of the following cont…
  3. Q3A research team wants their pre-trained language model to generate more helpful and harmless responses without extensiv…
  4. Q5Consider the following Python code snippet: After executing the code above, what will dataset.column_names return?
  5. Q6Which of the following statements accurately describe common characteristics or goals of subword tokenization algorithm…
  6. Q7A team has a powerful pre-trained language model (e.g., a GPT-3 class model). They want to adapt it for a new summariza…
  7. Q8Figure question
  8. Q9You start with an initial vocabulary consisting only of individual characters: {"a":10, "b":8, "c":5, "\</w>":15}. Your…
  9. Q10Consider the following Python code snippet: How many samples will filtered_dataset contain after executing the code?
  10. Q11Figure question
  11. Q12Based on the above data, answer the given subquestions.
  12. Q13Based on the provided configuration, calculate the total number of parameters in the model’s embedding layer (token emb…
  13. Q14Based on the provided configuration, what is a primary characteristic of this language model’s architecture and trainin…
  14. Q15Considering the Adam optimizer stores 2 floating-point values per model parameter and parameters are 32-bit floats (4 b…
  15. Q16The configuration states the model uses Byte Pair Encoding (BPE). What is a key implication of this choice for handling…