Quiz Space

Introduction to Natural Language Processing · End Term · 22 Dec 2024 · September 2024 term

Question 2: Which of the following are challenges in applying Shapley…

Question 2

+4 marksOne or more correct options

Which of the following are challenges in applying Shapley values for model explainability?

Select all that apply.

  1. A

    Computing Shapley values requires evaluating an exponential number of feature coalitions.

  2. B

    Shapley values assume independence between features, which may not hold in real-world data.

  3. C

    Shapley values are computationally efficient for deep neural networks.

  4. D

    Shapley values provide additive explanations, ensuring the contributions of all features sum up to the model's output.

Show answer

Correct answers

  • A

    Computing Shapley values requires evaluating an exponential number of feature coalitions.

  • B

    Shapley values assume independence between features, which may not hold in real-world data.

Question 2 of 28 in the IIT Madras BS Introduction to Natural Language Processing (Intro to NLP) End Term paper sat on 22 Dec 2024, in the September 2024 term (IIT M DEGREE FN EXAM QDB1 22 Dec 2024). It carries 4 marks.

More questions from this paper

  1. Q1What are the examples of a free morpheme?
  2. Q3Figure question
  3. Q4Figure question
  4. Q5Figure question
  5. Q6Consider top-k sampling with k = 4 as the decoding strategy for a large language model. For the context "I want to beco…
  6. Q7In a transformer model, attention rollout is used to compute the contribution of input tokens to the final output. Cons…
  7. Q8FastText is a word embedding model that extends Word2Vec by considering subword information through character n-grams (…
  8. Q9The Direct Preference Optimization (DPO) loss function is given as: L_{\text{DPO}}(\pi_\theta; \pi_{\text{ref}}) = -\ma…
  9. Q10Which of the following are suitable choices for an autoregressive language model with the primary objective of using it…
  10. Q11Figure question
  11. Q12What will be the 0th element in the positional encoding for a word at position 10000 in models with dimensions 512 and …
  12. Q13Which of the following approaches would be the best fit for these specific use cases? 1. A system that retrieves the la…
  13. Q14What are the inputs and outputs of the query encoder and passage encoder in the Dense Passage Retriever (DPR)?
  14. Q15Figure question
  15. Q16Figure question
  16. Q17Figure question
  17. Q18Which of the following is the embedding matrix?
  18. Q19Which of the following is the matrix corresponding to the feedforward connections between the embedding layer and the h…
  19. Q20Which of the following are true?
  20. Q21Based on the above data, answer the given subquestions.
  21. Q22Figure question
  22. Q23Consider an encoder-decoder transformer used for story generation. If we use exhaustive search to generate tokens for 2…
  23. Q24A decoder-only transformer-based language model is used to generate text based on some prompt. The language model is pr…
  24. Q25In the context of bias mitigation techniques, loss function modification would fall under which of the following catego…
  25. Q26Figure question
  26. Q27Which of the following techniques can be used to explain the predictions of a deep learning model by attributing the im…
  27. Q28Why is calculating Shapley values computationally expensive for models with a large number of features?