2025 MoE-CAP: Benchmarking Cost, Accuracy and Performance of Sparse Mixture-of-Experts Systems Yinsicheng Jiang*, Yao Fu* , Yeqi Huang*, Ping Nie , Zhan Lu , Leyang Xue, Congjie He , Man-Kit Sit , Jilong Xue , Li Dong , Ziming Miao , DaYou Du , Tairan Xu , Kai Zou , Edoardo Maria Ponti , and Luo Mai In NeurIPS , 2025 Paper Code 2024 ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models Yao Fu , Leyang Xue, Yeqi Huang, Andrei-Octavian Brabete , Dmitrii Ustiugov, Yuvraj Patel, and Luo Mai OSDI, 2024 Paper Code MoE-Infinity: Activation-Aware Expert Offloading for Efficient MoE Serving Leyang Xue, Yao Fu , Zhan Lu , Luo Mai, and Mahesh Marina arXiv preprint arXiv:2401.14361, 2024 arXiv Code 2023 TorchOpt: An Efficient Library for Differentiable Optimization Jie Ren*, Xidong Feng* , Bo Liu* , Xuehai Pan* , Yao Fu , Luo Mai, and Yaodong Yang JMLR, 2023 Paper Code 2022 Ekko: A Large-Scale deep learning recommender system with Low-Latency model update Chijun Sima*, Yao Fu* , Man-Kit Sit, Liyi Guo , Xuri Gong , Feng Lin , Junyu Wu , Yongsheng Li , Haidong Rong , Pierre-Louis Aublin , and Luo Mai OSDI, 2022 Paper