Intro to NLP End Term 22 Dec 2024 — Question 26
Show answer
Correct answer: 3
Question 26 of 28 in the IIT Madras BS Introduction to Natural Language Processing (Intro to NLP) End Term paper sat on 22 Dec 2024, in the September 2024 term (IIT M DEGREE FN EXAM QDB1 22 Dec 2024). It carries 5 marks.
More questions from this paper
- What are the examples of a free morpheme?
- Which of the following are challenges in applying Shapley values for model explainability?
- Figure question
- Figure question
- Figure question
- Consider top-k sampling with k = 4 as the decoding strategy for a large language model. For the context "I want to beco…
- In a transformer model, attention rollout is used to compute the contribution of input tokens to the final output. Cons…
- FastText is a word embedding model that extends Word2Vec by considering subword information through character n-grams (…
- The Direct Preference Optimization (DPO) loss function is given as: L_{\text{DPO}}(\pi_\theta; \pi_{\text{ref}}) = -\ma…
- Which of the following are suitable choices for an autoregressive language model with the primary objective of using it…
- Figure question
- What will be the 0th element in the positional encoding for a word at position 10000 in models with dimensions 512 and …
- Which of the following approaches would be the best fit for these specific use cases? 1. A system that retrieves the la…
- What are the inputs and outputs of the query encoder and passage encoder in the Dense Passage Retriever (DPR)?
- Figure question
- Figure question
- Figure question
- Which of the following is the embedding matrix?
- Which of the following is the matrix corresponding to the feedforward connections between the embedding layer and the h…
- Which of the following are true?
- Based on the above data, answer the given subquestions.
- Figure question
- Consider an encoder-decoder transformer used for story generation. If we use exhaustive search to generate tokens for 2…
- A decoder-only transformer-based language model is used to generate text based on some prompt. The language model is pr…
- In the context of bias mitigation techniques, loss function modification would fall under which of the following catego…
- Which of the following techniques can be used to explain the predictions of a deep learning model by attributing the im…
- Why is calculating Shapley values computationally expensive for models with a large number of features?