Learning rate Warmup1 Learning rate Warmup 요즘 코드들을 보고 있으면 Learning rate warm-up scheduler가 종종 보인다. 이는 논문 Bag of Tricks for Image Classification with Convolutional Neural Networks (2018) 에 나온 학습 방법 중 하나라고 하며 https://arxiv.org/abs/1812.01187 Bag of Tricks for Image Classification with Convolutional Neural Networks Much of the recent progress made in image classification research can be credited to training procedure refinements, such as ch.. 2021. 12. 27. 이전 1 다음
