Opening the paper…

Large Language Models, End Term

January 2026 term, 10 May 2026, Set 1

Learning mode

Question 1

+2−0Single correct

In the standard Transformer Decoder, the Multi-Head Attention layer is "Masked". What is the specific purpose of this mask during training?

Select one option

A.
To filter out padding tokens to save computation.
B.
To prevent the model from attending to the [CLS] and [SEP] special tokens.
C.
D.
To force the model to focus on the Encoder output rather than the Decoder input.

Report a problem

to report a problem with this question.

Choose a question

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 19

Discussion

Submit this paper?

You cannot change your answers after submitting.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Instructions

The palette shows the status of every question. Pick a number to go straight to it.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Save & Next moves to the next question. Answers are saved as you go.
Mark for Review & Next flags the question to come back to. A flagged answer still counts.
Clear Response removes your answer to the question on screen.
The ← and → keys move to the previous and next question.

In the standard Transformer Decoder, the Multi-Head Attention layer is "Masked". What is the specific purpose of this mask during training? Question text from the original paper, with its maths as pictures Question text from the original paper, with its maths as pictures