Which of the following preprocessing steps are commonly used when preparing data for transformer models like BERT?
Adding special tokens such as [CLS] and [SEP] to the sequence
Splitting tokens into subword units using a model-specific tokenizer
Removing all punctuation marks to ensure cleaner embeddings
Adding positional information to each token embedding
Correct answers
Adding special tokens such as [CLS] and [SEP] to the sequence
Splitting tokens into subword units using a model-specific tokenizer
Adding positional information to each token embedding
Question 4 of 17 in the IIT Madras BS Large Language Models (LLM) End Term paper sat on 31 Aug 2025, in the May 2025 term (IIT M DEGREE AN EXAM QDB3 31 Aug 2025). It carries 3 marks.
