Opening the paper…
Figure from the original question paper Consider a dataset with 150 samples and a batch size of 15. If each minibatch iteration contributes an average loss of 0.4, what will be the total loss after 15 epochs? If you use hierarchical softmax with a binary tree where each leaf node represents a word in the vocabulary, and the vocabulary size (*V* ) is 16000, how many binary classifiers are needed?