Frameworks for Large Language Model Serving in HPC Environments
Rohan Marwaha; Qinren Zhou; Kastan Day; Asmita Dabholkar; Volodymyr Kindratenko
- Published
- Publisher
- ACM
- Journal / collection
- Proceedings of the SC '25 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis
- Research area
- AI & compute
- Source type
- Conference paper
- DOI
- 10.1145/3731599.3767403
The original publisher provides the full text and its access options.
Cite this source
Rohan Marwaha; Qinren Zhou; Kastan Day; Asmita Dabholkar; Volodymyr Kindratenko. Frameworks for Large Language Model Serving in HPC Environments. Proceedings of the SC '25 Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis. 2025-11-15. https://doi.org/10.1145/3731599.3767403