Large Language Model Inference Acceleration Based on Hybrid Model Branch Prediction
Gaoxiang Duan; Jiajie Chen; Yueying Zhou; Xiaoying Zheng; Yongxin Zhu
- Published
- Publisher
- MDPI AG
- Journal / collection
- Electronics
- Research area
- AI & compute
- Source type
- Journal article
- DOI
- 10.3390/electronics13071376
The original publisher provides the full text and its access options.
Cite this source
Gaoxiang Duan; Jiajie Chen; Yueying Zhou; Xiaoying Zheng; Yongxin Zhu. Large Language Model Inference Acceleration Based on Hybrid Model Branch Prediction. Electronics. 2024-04-05. https://doi.org/10.3390/electronics13071376