optimization algorithm adam
Hello,
Can I choose batch size when I use adam algorithm or it's only confined with SGD algorithm?
I see you combined batching with SGD in one lesson so I thought it can be used only with SGD.
Thank you in advance.
1 answers ( 0 marked as helpful)
Hi Hady,
Usually with the TensorFlow syntax you can control the optimization algorithm and the learning rate with the same command.
The batch size itself is usually included either in the dataset preprocessing or in the 'fit' part of the model.
We have combined the theoretical lecture on SGD and batching, because that's how the normal logic goes. However, the TensorFlow syntax looks at it from a different standpoint.
Best,
The 365 Team