KO
12 Mar 2025
|
Paper Review
Scaling Laws
Distributed Training
LLM Pretraining
이번 글에서는 Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo 논문의 핵심 포인트만 간단히 정리한다. 2025년 3월 12일(Arxiv) Charles, Zachary, Teston, Gabriel, Dery, Lucio, Rush, Keith, Fallen, Nova, Garrett, Zachary, Szlam, Arthur, Douillard, Arthur. Google Research, Google Search, Google DeepMind 논문 링크 영문판 보기 요약 장치...
EN
10 Mar 2025
|
Paper Review
Text Embeddings
Multilingual Learning
Contrastive Learning
Synthetic Data
This article explains the key points of Gemini Embedding: Generalizable Embeddings from Gemini. 2025-03-10 (arXiv) Lee, Jinhyuk, Chen, Feiyang, Dua, Sahil, Cer, Daniel, Shanbhogue, Madhuri, Naim, Iftekhar, Ábrego, Gustavo Hernández, Li, Zhe, Chen, Kaifeng, Vera, Henrique Schechter, et al. Gemini Embedding Team, Google Paper Project Page Read this article in...
KO
10 Mar 2025
|
Paper Review
Text Embeddings
Multilingual Learning
Contrastive Learning
Synthetic Data
이번 글에서는 Gemini Embedding: Generalizable Embeddings from Gemini 논문의 핵심 포인트만 간단히 정리한다. 2025년 3월 10일(Arxiv) Lee, Jinhyuk, Chen, Feiyang, Dua, Sahil, Cer, Daniel, Shanbhogue, Madhuri, Naim, Iftekhar, Ábrego, Gustavo Hernández, Li, Zhe, Chen, Kaifeng, Vera, Henrique Schechter, et al. Gemini Embedding Team, Google 논문 링크 Project Page 영문판 보기...
EN
06 Mar 2025
|
Paper Review
Tool Use
Self-Distillation
Test-Time Scaling
This article explains the key points of START: Self-taught Reasoner with Tools. 2025-03-06 (arXiv) Li, Chengpeng, Xue, Mingfeng, Zhang, Zhenru, Yang, Jiaxi, Zhang, Beichen, Wang, Xiang, Yu, Bowen, Hui, Binyuan, Lin, Junyang, Liu, Dayiheng. University of Science and Technology of China, Alibaba Group Paper Read this article in Korean Summary...
KO
06 Mar 2025
|
Paper Review
Tool Use
Self-Distillation
Test-Time Scaling
이번 글에서는 START: Self-taught Reasoner with Tools 논문의 핵심 포인트만 간단히 정리한다. 2025년 3월 6일(Arxiv) Li, Chengpeng, Xue, Mingfeng, Zhang, Zhenru, Yang, Jiaxi, Zhang, Beichen, Wang, Xiang, Yu, Bowen, Hui, Binyuan, Lin, Junyang, Liu, Dayiheng. University of Science and Technology of China, Alibaba Group 논문 링크 영문판 보기 요약 START:...
