In RMSProp case, why is the function not monotonous?
Beta is [0,1]. So, (1- Beta) is also [0,1]. Nothing becomes negative. So in what case would the function decrease or go downwards?
1 answers ( 0 marked as helpful)
Function will decrease as the weights gets updated