Zhonglin Xie

Welcome to my personal homepage! I am a fourth-year Ph.D. student at the Beijing International Center for Mathematical Research, Peking University, under the guidance of Prof. Zaiwen Wen. I am a member of the Elite Ph.D. Program in Applied Mathematics.

My current research focus is on Large Language Models (LLMs), where I am particularly interested in addressing key challenges and advancing the state-of-the-art in this rapidly evolving field. My work centers around the following directions:

• Data selection strategies: Investigating how to optimize training and fine-tuning processes by selecting high-quality and diverse datasets to improve model performance and efficiency.
• More efficient and scalable Mixture-of-Experts (MoE) architectures: Designing innovative MoE structures that balance computational cost with model capacity, enabling better scalability for large-scale models.
• L2O techniques in LLM scenarios: Exploring how Learning to Optimize (L2O) can be applied to enhance optimization in LLM training and inference pipelines, such as adaptive learning rate scheduling and resource allocation.

I am actively seeking opportunities to transition into the LLM industry and contribute to cutting-edge advancements in this domain. If you are interested in my background or any of the research directions mentioned above, please feel free to contact me immediately—I would love to connect and explore potential collaborations or opportunities!

Previously, my research primarily focused on machine learning and optimization, with an emphasis on theoretical studies in Learning to Optimize (L2O). I worked on designing novel optimization algorithms using machine learning techniques and analyzing optimization methods from the perspective of ordinary differential equations (ODEs). Additionally, I explored how tools and insights from optimization could address challenges in deep learning.

I received my bachelor’s degree in 2021 from the School of Mathematical Sciences at Peking University, majoring in computational mathematics. During my undergraduate studies, I was also a member of the Elite Program of Applied Mathematics and Statistics for Undergraduates. Additionally, I earned a second bachelor’s degree in economics from the National School of Development between 2018 and 2021.

Looking forward to connecting with like-minded researchers and professionals!