About me
I am a PhD Student at the Department of Computer Science and Technology, University of Cambridge. My research interests are deeply rooted in Reinforcement Learning, Machine Learning, Machine Learning Systems, and the enhancement of real systems (e.g., Database, LLM fine-tuning, LLM serving) through machine learning techniques, named ML4Sys (especially RL4Sys). I have the privilege of being advised by Dr. Eiko Yoneki from the System Research Group at the Computer Lab, where we aim to push the boundaries of our field.
Prior to my current studies, I completed my Bachelor’s Degree in Physics at Peking University, Beijing, China, where I graduated with honors and a minor in math. During my tenure there, I was honored with the Excellent Graduate Student Award from the School of Physics and received recognition for my Excellent Graduation Thesis. My engagement in the academic community was further acknowledged through awards like the Special Award at the 5th Youth Tournament on Physics, underscoring my dedication and achievement in the field. This period of academic excellence was supported by the full fresher scholarship, a testament to my commitment and performance. Following my undergraduate studies, I pursued a Master’s Degree in Engineering at Johns Hopkins University, Baltimore, MD, USA, where I graduated as the top 1 student in my class. My PhD is also partially funded by The Pillman and Cody Award, University of Cambridge.
I am always keen on collaborations and any interesting research opportunities. I am also excited to work on cutting-edge research in Industries. Please feel free to contact me via Email:
Email: Taiyi.Wang@cl.cam.ac.uk
News! 🚀
📍 (2025.04) [IJCNN 2025] - OCMDP: Observation-Constrained Markov Decision Process
- Our recent work, OCMDP, was accepted by the International Joint Conference on Neural Networks (IJCNN) 2025. Feel free to check our paper here.
📍 (2025.02) [MLSys 2025] - ThunderServe: High-performance and Cost-efficient LLM Serving in Cloud Environments
- Our recent work ThunderServe was accepted by MLSys 2025. Feel free to check our paper here.
📍 (2025.01) [SIGMOD 2025] - A New Paradigm in Tuning Learned Indexes: A Reinforcement Learning-Enhanced Approach
- Exciting! Our latest work LITune was accepted by SIGMOD 2025. Feel free to check our paper and website here.
📍 (2025.01) [ICLR 2025] - DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agents
- I am very pleased to announce our latest work DistRL was accepted by ICLR 2025. We also released code and demos, feel free to check our project website here.
Selected Publications 📚
DistRL：An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agents
Taiyi Wang, Zhihao Wu, Jianheng Liu, Jianye Hao, Jun Wang, Kun Shao
International Conference on Learning Representations (ICLR) 2025 Poster
A novel distributed reinforcement learning framework for fine-tuning mobile language models.
A New Paradigm in Tuning Learned Indexes: A Reinforcement Learning-Enhanced Approach
Taiyi Wang, Liang Liang, Anson Yang, Thomas Heinis, Eiko Yoneki
International Conference on Management of Data (SIGMOD) 2025 Oral
LITune: A novel and reliable tuning framework for Learned Index.
Interests and Activities
Beyond my academic pursuits, I have a wide range of interests that highlight my commitment to personal growth and community involvement.
My passion for sports is evident in my role as the Captain of the Girton College Men 1st Tennis Team at the University of Cambridge, a position I’ve held since March 2022. This leadership role in sports is complemented by my pursuit of professional development in the field; I am currently working towards obtaining a PTR Level 1 tennis coaching certification. My enthusiasm for outdoor activities extends to skiing, where I am advancing my skills through the CASI Level 2 coaching certification. These endeavors reflect not only my love for sports but also my dedication to enhancing my coaching and leadership abilities in these areas.
My engagement with the community and broader societal contributions are deeply important to me. Since July 2015, I have been involved in long-term charitable activities, focusing on funding education for children in impoverished areas. This initiative stems from my belief in the transformative power of education and my commitment to making a positive impact on the lives of those less fortunate. Furthermore, my leadership and organizational skills were showcased during my time as the Director of the Debating Center at Peking University from March 2017 to March 2018, and as a Co-organizer for the Students’ International Communication Association (SICA) at Peking University between July 2016 and November 2016. These roles not only allowed me to contribute to the academic and personal development of my peers but also to foster international dialogue and understanding, underscoring my dedication to contributing positively to my community and beyond.
I also co-founded our Startup with Dr.Borong Hu. You can check details here Powersense Ltd..
