This led to me finding a paper on this issue https://arxiv.org/pdf/1801.05134.pdf.

By the way, if you’re using ReLU activations and *not* using batchnorm this scaling is unnecessary…
1
1
Michael Klachko
Yang Zhang
·Follow
1 min read·
May 5, 2019
--
This led to me finding a paper on this issue https://arxiv.org/pdf/1801.05134.pdf. Will take a look. Thank you!
--
--
Written by Yang Zhang319 Followers
·56 Following
Data science and machine learning
No responses yet
Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams