Question 10
Consider the embedding vector for a word, . Suppose the word is at position 3 in the given sentence. Add the corresponding position embedding to the word embedding to get , i.e. the sum of the elements in . Use the fixed sinusoidal position embedding vector calculated using the formula given below
What is the value of i.e. substract second element from the first element of vector ? (Answer correct up to 2 values after the decimal)