Opening the paper…

Deep Learning, Quiz 2

January 2025 term, 16 Mar 2025, Set QDB2

Learning mode

Question 1

+3−0Single correct

What is the impact of using a sigmoid activation function on the gradients when the input to the neuron is a very large negative number?

Select one option

A.
The output approaches 0 and the gradient approaches 0.
B.
The output approaches 0.5 and the gradient approaches 0.25.
C.
The output approaches 1 and the gradient approaches 0.
D.
The output approaches 0 and the gradient approaches 1.

Report a problem

to report a problem with this question.

Choose a question

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 22

Discussion

Submit this paper?

You cannot change your answers after submitting.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Instructions

The palette shows the status of every question. Pick a number to go straight to it.

Answered: 0
Not answered: 1
Marked for review: 0
Answered & marked for review: 0
Not visited: 2

Save & Next moves to the next question. Answers are saved as you go.
Mark for Review & Next flags the question to come back to. A flagged answer still counts.
Clear Response removes your answer to the question on screen.
The ← and → keys move to the previous and next question.

What is the impact of using a sigmoid activation function on the gradients when the input to the neuron is a very large negative number? Why is bias correction needed in the Adam optimizer? How do skip connections in ResNet work?