I'm a second-year Master student at Carnegie Mellon University. I work with Prof. Zhihao Jia and Prof. Rashmi Vinayak on large-scale distributed LLM serving on heterogeneous GPUs. My research interests span large-scale systems for LLM serving, KV-cache scheduling and ML compilers.
I was a Senior Software Engineer at ByteDance, where I mainly worked on large-scale scheduling systems and fault tolerance for AI infrastructure. I received my Bachelor's degree at Shanghai Jiao Tong University, where I worked with Prof. Shengyun Liu on distributed consensus protocols.