ALISE: Accelerating Large Language Model Serving with Speculative Scheduling
Youpeng Zhao; Jun Wang
- Published
- Publisher
- ACM
- Journal / collection
- Proceedings of the 43rd IEEE/ACM International Conference on Computer-Aided Design
- Research area
- AI & compute
- Source type
- Conference paper
- DOI
- 10.1145/3676536.3676659
The original publisher provides the full text and its access options.
Cite this source
Youpeng Zhao; Jun Wang. ALISE: Accelerating Large Language Model Serving with Speculative Scheduling. Proceedings of the 43rd IEEE/ACM International Conference on Computer-Aided Design. 2024-10-27. https://doi.org/10.1145/3676536.3676659