Question 4
Select correct statements about sinusoidal positional encoding:
It produces a unique encoding for each time-step (token’s position in asentence)
Distance between two tokens at time-steps 3 and 4 is independent of thelength of the input sequence.
It is non-deterministic.
None of these.