LLMVisor: A Real-Time Latency Attribution Model for Multi-Tenant LLM Serving

Shuowei Jin, Xueshen Liu, Jiaxin Shan, Le Xu, Tieying Zhang, Liguang Xie, Z. Morley Mao
December, 2025
PDF
Type
Conference paper
Publication
Workshop on ML for Systems at NeurIPS 2025
LLM
Shuowei Jin
Shuowei Jin
Applied Scientist at Amazon

My research interests include efficient LLM inference/training algorithms/systems, LLM post-training recipe, and general machine learning systems.