Difference between Learning rate and Momentum?
Can you please precisely tell the difference between learning rate and momentum.
Why two variables for same purpose?
1 answers ( 0 marked as helpful)
Hi Darien
Learning rate is the big concept that you know from the beginning.
Momentum is a notion, an idea that tries to show how to adjust the learning rate to reach the optimal learning rate.
So they are not two different variables or notions. Momentum is a part of the learning rate.
Best,
The 365 Team