Can you please precisely tell the difference between learning rate and momentum.
Why two variables for same purpose?
Learning rate is the big concept that you know from the beginning.
Momentum is a notion, an idea that tries to show how to adjust the learning rate to reach the optimal learning rate.
So they are not two different variables or notions. Momentum is a part of the learning rate.
The 365 Team