Mar 28, 2025 | I’ll be giving a tutorial and demo on ServerlessLLM at the SESAME’25 workshop, co-located with ASPLOS and EuroSys in Rotterdam on March 31. I’ll also be attending the main conferences—let me know if you’d like to connect! |
Jan 22, 2025 | I’ll be visiting University of Pennsylvania (29 Jan) and Columbia University to present our latest work on Serverless AI, focusing on the efficient sharing of AI infrastructures. Check details here. I’ll be in Philly, DC, and NYC from Jan 27 to Feb 5. If you’re in the area and interested in having a chat, let’s meet up! |
Oct 01, 2024 | I’m honored to serve as a reviewer for IEEE Transactions on Mobile Computing (TMC). I’m excited about the opportunity to contribute to the community in this new role! |
May 16, 2024 | I’m selected as one of the ML and Systems Rising Stars! Thanks to everyone who has supported me along the way! I’ll be attending the workshop at NVIDIA’s headquarters in Santa Clara, CA, on July 15-16. |
Mar 21, 2024 | Our paper “ServerlessLLM: Locality-Enhanced Serverless Inference for Large Language Models” has been accepted to OSDI 2024. Preprint available on ArXiv. Code will be released soon. Stay tuned! |
Jan 25, 2024 | We released two new papers on ArXiv! Check them out: ServerlessLLM and MoE-Infinite |