EN
28 Jul 2025
|
Paper Review
On-Device Inference
Mixture-of-Experts
Sparse Inference
This article explains the key points of SmallThinker: A Family of Efficient Large Language Models Natively Trained for Local Deployment. 2025-07-28 (arXiv) Song, Yixin, Xue, Zhenliang, Wei, Dongliang, Chen, Feiyang, Gao, Jianxiang, Liu, Junchen, Liang, Hangyu, Qin, Guangshuo, Tian, Chengrong, Wen, Bo, et al. Institute of Parallel and Distributed Systems,...
KO
28 Jul 2025
|
Paper Review
On-Device Inference
Mixture-of-Experts
Sparse Inference
이번 글에서는 SmallThinker: A Family of Efficient Large Language Models Natively Trained for Local Deployment 논문의 핵심 포인트만 간단히 정리한다. 2025년 7월 28일(Arxiv) Song, Yixin, Xue, Zhenliang, Wei, Dongliang, Chen, Feiyang, Gao, Jianxiang, Liu, Junchen, Liang, Hangyu, Qin, Guangshuo, Tian, Chengrong, Wen, Bo, et al. Institute of Parallel and Distributed...
EN
28 Jul 2025
|
Paper Review
Synthetic Data
Mathematical Reasoning
Supervised Fine-Tuning
This article explains the key points of SAND-Math: Using LLMs to Generate Novel, Difficult and Useful Mathematics Questions and Answers. 2025-07-28 (arXiv), 39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: MATH-AI Manem, Chaitanya, Brahma, Pratik Prabhanjan, Mishra, Prakamya, Liu, Zicheng, Barsoum, Emad. Advanced Micro Devices, Inc. (AMD) Paper...
KO
28 Jul 2025
|
Paper Review
Synthetic Data
Mathematical Reasoning
Supervised Fine-Tuning
이번 글에서는 SAND-Math: Using LLMs to Generate Novel, Difficult and Useful Mathematics Questions and Answers 논문의 핵심 포인트만 간단히 정리한다. 2025년 7월 28일(Arxiv), 39th Conference on Neural Information Processing Systems (NeurIPS 2025) Workshop: MATH-AI Manem, Chaitanya, Brahma, Pratik Prabhanjan, Mishra, Prakamya, Liu, Zicheng, Barsoum, Emad. Advanced Micro Devices, Inc. (AMD)...
EN
24 Jul 2025
|
Paper Review
Reinforcement Learning
Mixture-of-Experts
Loss Functions
This article explains the key points of Group Sequence Policy Optimization. 2025-07-24 (arXiv) Zheng, Chujie, Liu, Shixuan, Li, Mingze, Chen, Xiong-Hui, Yu, Bowen, Gao, Chang, Dang, Kai, Liu, Yuqiong, Men, Rui, Yang, An, et al. Qwen Team, Alibaba Inc. Paper Read this article in Korean Summary Reward-based training of language...