STAPLE: Static Sparse Upcycling of Pretrained Checkpoints via Embedding Modules

Publication
arXiv
Shuowei Jin
Shuowei Jin
Applied Scientist at Amazon

My research interests include efficient LLM inference/training algorithms/systems, LLM post-training recipe, and general machine learning systems.