This article explains the key points of No More Adam: Learning Rate Scaling at Initialization is All You Need. 2024-12-16 (arXiv) Xu, Minghao, Xiang, Lichuan, Cai, Xu, Wen, Hongkai. Department of Computer Science, University of Warwick, Coventry, UK, Collov Labs Paper Github Read this article in Korean Summary AdamW, an...

이번 글에서는 No More Adam: Learning Rate Scaling at Initialization is All You Need 논문의 핵심 포인트만 간단히 정리한다. 2024년 12월 16일(Arxiv) Xu, Minghao, Xiang, Lichuan, Cai, Xu, Wen, Hongkai. Department of Computer Science, University of Warwick, Coventry, UK, Collov Labs 논문 링크 Github 영문판 보기 요약 AdamW는 기울기 이력을...

This article explains the key points of Video Creation by Demonstration. 2024-12-12 (arXiv) Sun, Yihong, Zhou, Hao, Yuan, Liangzhe, Sun, Jennifer J., Li, Yandong, Jia, Xuhui, Adam, Hartwig, Hariharan, Bharath, Zhao, Long, Liu, Ting. Google DeepMind, Cornell University Paper Project Page Read this article in Korean Summary Video Creation by...

이번 글에서는 Video Creation by Demonstration 논문의 핵심 포인트만 간단히 정리한다. 2024년 12월 12일(Arxiv) Sun, Yihong, Zhou, Hao, Yuan, Liangzhe, Sun, Jennifer J., Li, Yandong, Jia, Xuhui, Adam, Hartwig, Hariharan, Bharath, Zhao, Long, Liu, Ting. Google DeepMind, Cornell University 논문 링크 Project Page 영문판 보기 요약 Video Creation by Demonstration은...

This article explains the key points of Phi-4 Technical Report. 2024-12-12 (arXiv) Abdin, Marah, Aneja, Jyoti, Behl, Harkirat, Bubeck, Sébastien, Eldan, Ronen, Gunasekar, Suriya, Harrison, Michael, Hewett, Russell J., Javaheripi, Mojan, Kauffmann, Piero, et al. Microsoft Research Paper Read this article in Korean Summary Improving a compact language model’s reasoning...