About me
Hi! I’m a 2nd-year Ph.D. student majoring in computer science in the School of Computer Science and Engineering at Sun Yat-sen University. I am fortunately advised by Prof. Nong Xiao. Prior to that, I received my Bachelor degree in computer science from the School of Computer Science and Engineering, Sun Yat-sen University. Currently, I work as a research intern at Alibaba Cloud PAI Group from July 2024.
You can find my cv here: Yuanxin Wei’s Curriculum Vitae
💻 Research Interest
My research interest focuses on Machine Learning System and High Performance Computing, including:
- Algorithm-System Co-Design.
- Cost-Efficient LLM systems.
- Accelerating ML workloads.
🌟 News
- [08/07/24] Start working as a research intern at Alibaba Cloud PAI Group. Back to Beijing again!
- [15/06/24] One paper accepted by SC 2024!
- [25/03/24] Attend the DATE 2024 conference in Valencia, Spain and give an oral presentation.
- [12/11//24] First paper accepted by DATE 2024! Many many thanks to Advisor Jiangsu Du.
- [01/09/24] Start my PH.D. journey!
- [30/06/24] Got my Bachelor degree! My wonderful four years.
- [30/05/24] Start my first intership as a technical support in Lark, ByteDance, Shenzhen.
- [01/09/24] Start my college life at Sun Yat-sen University in Guangzhou.
- [30/06/19] Finish three years of high school life in Beijing.
📄 Publications
Yuanxin Wei, Jiangsu Du*, Jiazhi Jiang, Xiao Shi, Xianwei Zhang, Dan Huang*, Nong Xiao, Yutong Lu. APTMoE: Affinity-aware Pipeline Tuning for MoE Models on Bandwidth-constrained GPU Nodes. SC 2024 (22.7%), [slide].
Yuanxin Wei, Shengyuan Ye, Jiazhi Jiang, Xu Chen, Dan Huang*, Jiangsu Du*, Yutong Lu. Communication-Efficient Model Parallelism for Distributed In-situ Transformer Inference. DATE 2024 (25%), [slide][code].
Jiangsu Du, Yuanxin Wei, Shengyuan Ye, Jiazhi Jiang, Xu Chen, Dan Huang*, Yutong Lu. Co-designing Transformer Architectures for Distributed Inference with Low Communication. TPDS 2024.
Yu Li, Yuanxin Wei, Jiangsu Du*, Dan Huang*. Understanding the Inference Performance of Spatial Temporal Diffusion Transformer. NPC 2024.
🏆 Awards
- Chinese National Scholarship (Top 1%), 2021
- Principal scholarship of Sun Yat-sen University (Top 5%), 2023
- Outstanding Undergraduate Graduates of Sun Yat-sen University, 2023
- Outstanding undergraduate thesis, 2023
- First-Prize Scholarship of Sun Yat-sen University (Top 5%), 2021
- Second-Prize Scholarship of Sun Yat-sen University × 2 (Top 10%), 2020, 2022