Publication

Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study

返回学术发表
Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study 论文配图

Peiyu Liu, Zikang Liu, Ze-Feng Gao, Dawei Gao, Wayne Xin Zhao#,Yaliang Li, Bolin Ding, Ji-Rong Wen

Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (COLING 2024), 2024

摘要

This work aims to investigate the impact of quantization on \emph{emergent abilities}, which are important characteristics that distinguish LLMs from small language models. Specially, we examine the abilities of in-context learning, chain-of-thought reasoning, and instruction-following in quantized LLMs.