Quiz Space

Deep Learning Practice · Quiz 1 · 26 Oct 2025 · September 2025 term

Question 3: A company wants to align its chatbot with values of being…

Question 3

+2 marksOne correct option

A company wants to align its chatbot with values of being helpful, harmless, and honest. Human labelers provide ideal responses and rank AI-generated outputs. Which adaptation technique is designed for this?

  1. A

    Instruction Tuning

  2. B

    Zero-shot prompting

  3. C

    Reinforcement Learning from Human Feedback (RLHF)

  4. D

    Continued pre-training

Show answer

Correct answer

  • C

    Reinforcement Learning from Human Feedback (RLHF)

See the whole paperTake it as a mock test

Question 3 of 15 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 1 paper sat on 26 Oct 2025, in the September 2025 term (IIT M DEGREE AN EXAM QDB2 26 Oct 2025). It carries 2 marks.

More questions from this paper

  1. Q1Which of the following statements best describes the primary advantage of the SentencePiece tokenizer compared to a sta…
  2. Q2When performing full fine-tuning of a large language model (e.g., 10B parameters) using Adam, which component consumes …
  3. Q4Figure question
  4. Q5After running the following Hugging Face datasets code snippet, what will be the features of the dataset?
  5. Q6What is a key implication of using a Parameter-Efficient Fine-Tuning (PEFT) method like LoRA when adapting a large lang…
  6. Q7The WordPiece tokenization algorithm, unlike BPE, does not merge the pair with the highest frequency. Instead, it merge…
  7. Q8Which of the following statements accurately describes the Causal Language Modeling (CLM) objective used to pre-train m…
  8. Q9A research lab has access to a powerful 175B parameter language model. They need to adapt it for a highly specialized l…
  9. Q10A team is fine-tuning a 7B parameter model on a single GPU with 24GB of memory. They are using the Adam optimizer (whic…
  10. Q11The evolution of NLP models shows a distinct shift from task-specific architectures to a ”pre-train, finetune” paradigm…
  11. Q12The three main families of Transformer-based models are Encoder-only (e.g., BERT), Decoder-only (e.g.,GPT), and Encoder…
  12. Q13Figure question
  13. Q14A single transformer block in a GPT-style model has the following configuration: embedding dimension (d model) = 1024, …
  14. Q15You are given a GPT-style model with a vocabulary size of 50,257, a context length of 1024, and an embedding dimension …