Gorio Tech Blog search

TinyGSM: achieving >80% on GSM8k with small language models 요약 설명

KO 14 Dec 2023 | Paper Review Mathematical Reasoning Synthetic Training Data Reward Modeling

이번 글에서는 TinyGSM: achieving >80% on GSM8k with small language models 논문의 핵심 포인트만 간단히 정리한다. 2023년 12월 14일(Arxiv) Liu, Bingbin, Bubeck, Sebastien, Eldan, Ronen, Kulkarni, Janardhan, Li, Yuanzhi, Nguyen, Anh, Ward, Rachel, Zhang, Yi. Carnegie Mellon University, Microsoft Research 논문 링크 영문판 보기 요약 이 논문은 소형 언어 모델이...

Comment  Read more

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention | Summary

EN 13 Dec 2023 | Paper Review Mixture-of-Experts Efficient Attention Language Models

This article explains the key points of SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention. 2023-12-13 (arXiv), 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Csordás, Róbert, Piękos, Piotr, Irie, Kazuki, Schmidhuber, Jürgen. Stanford University, Stanford, CA, USA, AI Initiative, KAUST, Thuwal, Saudi Arabia, Center for Brain Science, Harvard University, Cambridge,...

Comment  Read more

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention 요약 설명

KO 13 Dec 2023 | Paper Review Mixture-of-Experts Efficient Attention Language Models

이번 글에서는 SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention 논문의 핵심 포인트만 간단히 정리한다. 2023년 12월 13일(Arxiv), 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Csordás, Róbert, Piękos, Piotr, Irie, Kazuki, Schmidhuber, Jürgen. Stanford University, Stanford, CA, USA, AI Initiative, KAUST, Thuwal, Saudi Arabia, Center for Brain Science, Harvard University,...

Comment  Read more

LLM in a flash: Efficient Large Language Model Inference with Limited Memory | Summary

EN 12 Dec 2023 | Paper Review Efficient Inference Sparse Inference On-Device Inference

This article explains the key points of LLM in a flash: Efficient Large Language Model Inference with Limited Memory. 2023-12-12 (arXiv) Alizadeh, Keivan, Mirzadeh, Iman, Belenko, Dmitry, Khatamifard, Karen, Cho, Minsik, Del Mundo, Carlo C, Rastegari, Mohammad, Farajtabar, Mehrdad. Apple Paper Read this article in Korean Summary Running a large...

Comment  Read more

LLM in a flash: Efficient Large Language Model Inference with Limited Memory 요약 설명

KO 12 Dec 2023 | Paper Review Efficient Inference Sparse Inference On-Device Inference

이번 글에서는 LLM in a flash: Efficient Large Language Model Inference with Limited Memory 논문의 핵심 포인트만 간단히 정리한다. 2023년 12월 12일(Arxiv) Alizadeh, Keivan, Mirzadeh, Iman, Belenko, Dmitry, Khatamifard, Karen, Cho, Minsik, Del Mundo, Carlo C, Rastegari, Mohammad, Farajtabar, Mehrdad. Apple 논문 링크 영문판 보기 요약 대규모 언어 모델(LLM)의 가중치가...

Comment  Read more