Quiz Space

Deep Learning Practice · Quiz 2 · 16 Mar 2025 · January 2025 term

Question 9: You transcribed an audio recording using Whisper and appl…

Question 9

+3 marksOne or more correct options

You transcribed an audio recording using Whisper and applied speaker diarization. However, you notice that the transcribed text is accurate, but the speaker labels frequently change mid- sentence, even when the same person is speaking.
Which of the following are definite causes of this issue?

Select all that apply.

  1. A

    The speaker segments are too short, causing the clustering model to misclassify speakers.

  2. B

    Whisper does not support speaker diarization, so the labels are randomly assigned.

  3. C

    The timestamps from Whisper do not align with the diarization output, leading to incorrect speaker switching.

  4. D

    The transcription model has misrecognized words, which affects speaker identification.

Show answer

Correct answers

  • A

    The speaker segments are too short, causing the clustering model to misclassify speakers.

  • C

    The timestamps from Whisper do not align with the diarization output, leading to incorrect speaker switching.

See the whole paperTake it as a mock test

Question 9 of 19 in the IIT Madras BS Deep Learning Practice (Deep Learning Practice) Quiz 2 paper sat on 16 Mar 2025, in the January 2025 term (IIT M DEGREE AN EXAM QDB2 16 Mar 2025). It carries 3 marks.

More questions from this paper

  1. Q1Consider the following code using Wav2Vec2Processor to process an audio sample: What will the printed shape be?
  2. Q2Consider the following code snippet: What is the primary mistake in this code?
  3. Q3You have a model that predicts transcriptions for audio clips. You calculate Word Error Rate (WER) using the jiwer pack…
  4. Q4What type of language modeling objective does the Whisper model use during training?
  5. Q5Why is Wav2Vec2CTCTokenizer used instead of directly using Wav2Vec2Processor for tokenization?
  6. Q6Figure question
  7. Q7Which of the following correctly describes the end-to-end ASR workflow when training a Wav2Vec2 model?
  8. Q8Which of the following statements are True?
  9. Q10Consider the following Whisper transcription function: Which of the following statements are correct about this code?
  10. Q11A speaker diarization pipeline typically consists of multiple components.\ Which of the following components are essent…
  11. Q12Figure question
  12. Q13The following code snippet uses librosa to process an audio file: If audio_data.shape outputs (320000,), how long (in s…
  13. Q14Below is a snippet for loading a SpeechBrain speaker verification model: The speaker verification model uses x-vector e…
  14. Q15Consider the following 1D Convolutional Neural Network code: Based on the above data, answer the given subquestions. Wh…
  15. Q16Consider the following 1D Convolutional Neural Network code: Based on the above data, answer the given subquestions. Wh…
  16. Q17Below is a snippet for fine-tuning SpeechT5 for Text-to-Speech (TTS): Based on the above data, answer the given subques…
  17. Q18Below is a snippet for fine-tuning SpeechT5 for Text-to-Speech (TTS): Based on the above data, answer the given subques…
  18. Q19Below is a snippet for fine-tuning SpeechT5 for Text-to-Speech (TTS): Based on the above data, answer the given subques…