Gorio Tech Blog
이번 글에서는 Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions 논문의 핵심 포인트만 간단히 정리한다. 2024년 11월 21일(Arxiv) Zhao, Yu, Yin, Huifeng, Zeng, Bo, Wang, Hao, Shi, Tianqi, Lyu, Chenyang, Wang, Longyue, Luo, Weihua, Zhang, Kaifu. MarcoPolo Team, Alibaba International Digital Commerce 논문 링크 Github 영문판 보기 요약 Marco-o1은 구어체...
This article explains the key points of Hymba: A Hybrid-head Architecture for Small Language Models. 2024-11-20 (arXiv) Dong, Xin, Fu, Yonggan, Diao, Shizhe, Byeon, Wonmin, Chen, Zijia, Mahabaleshwarkar, Ameya Sunil, Liu, Shih-Yang, Van Keirsbilck, Matthijs, Chen, Min-Hung, Suhara, Yoshi, et al. NVIDIA, Georgia Institute of Technology, USA, HKUST Paper Github...
이번 글에서는 Hymba: A Hybrid-head Architecture for Small Language Models 논문의 핵심 포인트만 간단히 정리한다. 2024년 11월 20일(Arxiv) Dong, Xin, Fu, Yonggan, Diao, Shizhe, Byeon, Wonmin, Chen, Zijia, Mahabaleshwarkar, Ameya Sunil, Liu, Shih-Yang, Van Keirsbilck, Matthijs, Chen, Min-Hung, Suhara, Yoshi, et al. NVIDIA, Georgia Institute of Technology, USA, HKUST 논문...
This article explains the key points of RedPajama: an Open Dataset for Training Large Language Models. 2024-11-19 (arXiv), 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Track on Datasets and Benchmarks Weber, Maurice, Fu, Daniel, Anthony, Quentin, Oren, Yonatan, Adams, Shane, Alexandrov, Anton, Lyu, Xiaozhong, Nguyen, Huu, Yao, Xiaozhe,...
이번 글에서는 RedPajama: an Open Dataset for Training Large Language Models 논문의 핵심 포인트만 간단히 정리한다. 2024년 11월 19일(Arxiv), 38th Conference on Neural Information Processing Systems (NeurIPS 2024) Track on Datasets and Benchmarks Weber, Maurice, Fu, Daniel, Anthony, Quentin, Oren, Yonatan, Adams, Shane, Alexandrov, Anton, Lyu, Xiaozhong, Nguyen, Huu, Yao,...