Opening the paper…

Introduction to Deep Learning and Generative AI, End Term

January 2026 term, 10 May 2026, Set S2

Learning mode

Question 1

+4−0Multiple correct

Which of the following orders of operations is/are CORRECT for a single training iteration in PyTorch?

Select all that apply

Select all that apply.

A.
Forward → Backward → Zero gradients → Optimizer step
B.
Forward → Zero gradients → Backward → Optimizer step
C.
Zero gradients → Optimizer step → Forward → Backward
D.
Zero gradients → Forward → Backward → Optimizer step
E.
Backward → Forward → Optimizer step → Zero gradients

Report a problem

to report a problem with this question.

Choose a question

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 23

Discussion

Submit this paper?

You cannot change your answers after submitting.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Instructions

The palette shows the status of every question. Pick a number to go straight to it.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Save & Next moves to the next question. Answers are saved as you go.
Mark for Review & Next flags the question to come back to. A flagged answer still counts.
Clear Response removes your answer to the question on screen.
The ← and → keys move to the previous and next question.

Which of the following orders of operations is/are CORRECT for a single training iteration in PyTorch? Which of the following is/are NOT present in a standard GPT (decoder-only) model? Consider the following RAG pipeline: Figure from the original question paper Which of the following is/are true?