Opening the paper…
Figure from the original question paper Which of the following is true regarding sinusoidal encoding? We have a transformer model translating English to French. Suppose the target sequence is: Target (French): [‘je’, ‘suis’, ‘heureux’] Suppose the model predicted at time step t: t = 1: ‘je’ t = 2: ‘content’ t = 3: ‘heureux’ If teacher forcing is used, what will be the decoder input at time step 3?