Question 1
What are the possible outcomes if we don’t do bias correction in ADAM?
The Algorithm will not converge to a local or global minima.
It would lead to initial updates that are much smaller.
It would lead to initial updates which are much larger.