Skip to content
OPEN VARIABLE

Evidence-First Signal Intelligence

Menu

Research literature / Conference paper

Queue Management for SLO-Oriented Large Language Model Serving

Archit Patke; Dhemath Reddy; Saurabh Jha; Haoran Qiu; Christian Pinto; Chandra Narayanaswami; Zbigniew Kalbarczyk; Ravishankar Iyer

Published
Publisher
ACM
Journal / collection
Proceedings of the ACM Symposium on Cloud Computing
Research area
AI & compute
Source type
Conference paper
DOI
10.1145/3698038.3698523

Read the original source ↗

The original publisher provides the full text and its access options.

Cite this source

Archit Patke; Dhemath Reddy; Saurabh Jha; Haoran Qiu; Christian Pinto; Chandra Narayanaswami; Zbigniew Kalbarczyk; Ravishankar Iyer. Queue Management for SLO-Oriented Large Language Model Serving. Proceedings of the ACM Symposium on Cloud Computing. 2024-11-20. https://doi.org/10.1145/3698038.3698523

Download RIS