The 365 Data Science team is proud to invite you to our own community forum. A very well built system to support your queries, questions and give the chance to show your knowledge and help others in their path of becoming Data Science specialists.
Ask
Anybody can ask a question
Answer
Anybody can answer
Vote
The best answers are voted up and moderated by our team

Introduction to TensorFlow 2 – Model layout: learning rate, input size not specified

Introduction to TensorFlow 2 – Model layout: learning rate, input size not specified

0
Votes
1
Answer

In lesson https://365datascience.teachable.com/courses/deep-learning-with-tensorflow2/lectures/10998893 we defined a variable input_size but we don’t seem to use it, so why define it?
We also don’t specify a learning rate, contrary to the numpy implementation; how is this managed in tensorflow?

1 Answer

365 Team
0
Votes

Hi JeanMichel,
Thanks for reaching out and very good questions indeed!
TensorFlow 2.0 can now automatically detect that and there is no need to explicitly write it. However, sometimes (especially when dealing with CNNs) we need to preprocess the input layer in some way. Therefore, it is a good practice to specify it.
Regarding the learning rate, since we are using Adam, the initial learning rate is mostly irrelevant. The algorithm will find (adapt) the best learning rate for each weight individually!
Best,
Iliya