Opening the paper…

Large Language Models, End Term

September 2025 term, 21 Dec 2025, Set 1

Learning mode

Question 1

+1−0Single correct

What happens when you use Batch Normalization with a batch size of 1?

Select one option

A.
It works perfectly fine
B.
The statistics become meaningless (mean=0, std=0)
C.
It automatically switches to Layer Normalization
D.
It uses the running statistics from training

Report a problem

to report a problem with this question.

Choose a question

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 23

Discussion

Submit this paper?

You cannot change your answers after submitting.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Instructions

The palette shows the status of every question. Pick a number to go straight to it.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Save & Next moves to the next question. Answers are saved as you go.
Mark for Review & Next flags the question to come back to. A flagged answer still counts.
Clear Response removes your answer to the question on screen.
The ← and → keys move to the previous and next question.

What happens when you use Batch Normalization with a batch size of 1? A language model outputs the following logits for the next token: \{cat: 3.2, dog: 2.9, bird: 1.1, fish: 0.5, snake: -0.4\} Before sampling, the decoding pipeline performs: • Temperature scaling with T = 2.0 • Top-K filtering with K = 3 After applying both steps, which tokens remain eligible for sampling? Question text from the original paper, with its maths as pictures