Question 4
Which of the following tokenization algorithms can be applied to languages that do not have any word delimiters?
BPE (Byte Pair Encoding)
Wordpiece
Sentencepiece
Question 4: Which of the following tokenization algorithms can be app…
Show answer
Correct answer
Sentencepiece
Question 4 of 15 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 1 paper sat on 27 Oct 2024, in the September 2024 term (IIT M DEGREE AN EXAM QDB2 27 Oct 2024). It carries 3 marks.
More questions from this paper
- Figure question
- Choose the Hugging Face module that helps us train a tokenizer from scratch on a specific dataset.
- A dataset contains 10 billion words ( separated by a single white space). Suppose we use a pre- trained tokenizer that …
- Consider the Wikipedia dataset scraped from the web that contains 2 billion words. A team decided to use the BPE tokeni…
- Suppose that we pre-train a Causal Language Model. Choose the data collator function from the Hugging Face library that…
- The IMDB dataset has 25000 samples in the training split. It contains two columns, named, text and label. Consider the …
- Consider two datasets namely "ds1" and "ds2" . The structure of the dataset with the number of samples in each split is…
- Figure question
- Figure question
- Here is a configuration of the GPTNeo model from the Hugging Face hub. Figure 1: GPTNeoConfig Based on the above data, …
- Here is a configuration of the GPTNeo model from the Hugging Face hub. Figure 1: GPTNeoConfig Based on the above data, …
- Here is a set of training arguments used by the GPT-2 model that was pre-trained on a dataset that contains 10 billion …
- Here is a set of training arguments used by the GPT-2 model that was pre-trained on a dataset that contains 10 billion …
- Figure question